r 

AD-A115  496  AIR  FORCE  INST  OF  TECH  WRI6HT-PATTERS0N  AFB  OH  SCHOO— ETC  F/G  9/2 

ANALYSIS  OF  THE  OPTIMUM  RECEIVER  DESI6N  PROBLEM  USING  INTERACTS- ETC <U> 
DEC  81  M  R  MAZZUCCHI 

UNCLASSIFIED  AFIT/GE/EE/B1D-39  NL 


UNITED  STATES  AIR  FORCE 
AIR  UNIVERSITY 

AIR  FORCE  INSTITUTE  OF  TECHNOLOG 

Wright-Pattvrson  Air  Fore*  Bas«,Ohio 


AFIT/GE/EE/81D-39 


ANALYSIS  OF  THE  OPTIMUM  RECEIVER 
DESIGN  PROBLEM  USING  INTERACTIVE 
COMPUTER  GRAPHICS 


THESIS 


AFIT/GE/EE/81D-39  Michael R.  Mazzucchi 

Cpt  USA 


Approved  for  public  release;  distribution  unlimited 


AFIT/GE/EE/81D-39 


ANALYSIS  OF  THE  OPTIMUM  RECEIVER 
DESIGN  PROBLEM  USING  INTERACTIVE 
COMPUTER  GRAPHICS 

THESIS 

Presented  to  the  Faculty  of  the  School  of  Engineering 
of  the  Air  Force  Institute  of  Technology 
Air  University 

in  Partial  Fulfillment  of  the 
Requirements  for  the  Degree  of 
Master  of  Science 


by 

Michael  R.  Mazzucchi ,  B.S. 

Captain  USA 

Graduate  Electrical  Engineering 
December  1981 

Approved  for  public  release;  distribution  unlimited. 


Preface 


The  purpose  of  this  study  was  to  design  a  tool  to 
assist  engineering  students  learning  signal  detection  theory 
and  its  application  to  communication  receiver  design.  It 
was  my  own  experience  that  essential  insight  is  gained  from 
working  through  several  variations  of  a  single  problem  and 
working  several  different  such  problems.  This,  however, 
requires  much  time  and  it  is  hoped  this  program  will  allow 
users  to  obtain  this  understanding  with  considerably  less 
expenditure  of  time. 

It  is  with  sincere  gratitude  I  acknowledge 
Major  Kenneth  Castor.  He  first  introduced  and  schooled  me 
in  signal  detection  and  estimation  theory  and  it  was  his 
original  proposal  which  resulted  in  this  project.  I  am 
deeply  indebted  to  him  for  his  constant  enthusiasm,  his 
abundant  recommendations,  and  enlightening  discussions 
throughout  our  association. 

Special  thanks  is  due  Professor  Charles  Richard  who 
always  stopped  and  took  the  time  to  listen  to  and  help 
resolve  the  numerous  programming  problems. 

Finally,  I  want  to  express  my  appreciation  to  my 
wife,  Linda,  not  only  for  her  encouragement  and  understanding 
all  along  the  way,  but  also  for  the  hours  spent  proofreading 
and  for  her  many  helpful  suggestions. 


Michael  R.  Mazzucchi 


ii 


Contents 

Page 

Preface .  ii 

List  of  Figures .  vi 

List  of  Tables . viii 

Abstract .  ix 

I.  Introduction  .  1 

Problem  .  2 

Scope .  3 

Assumptions  and  Limitations  .  3 

Approach  and  Presentation  .  4 

II.  Theory  of  Detection  .  6 

Introduction  .  6 

Classifying  the  Detection  Problem  .  7 

The  Decision  Rule .  11 

Discussion  of  the  Probability  of  Error 

Criterion .  14 

The  Concept  of  the  Sufficient 

Statistic .  19 

Discussion  of  the  General  Gaussian 

Problem .  20 

Decision  Rule  for  Multiple  Signals  .  27 

Probability  of  Error  for  Multiple 

Decisions .  34 

Concept  of  the  Union  Bound .  35 

III.  Concept  and  Design  of  Software .  43 

Introduction  .  43 

Main  Program  Operation  .  44 

Data  Input  Subroutines  .  46 

Subroutine  CURSOR  .  46 

Subroutine  DIRECT  .  48 

Subroutine  TRANS  .  48 

Subroutine  ROTATE  .  49 

Subroutine  ADDGRA  .  50 

Subroutine  ADDDIR  .  51 

Subroutine  DELETE  .  51 

Subroutine  SNOISE  .  51 

Subroutine  SGPROB  .  52 

Subroutine  SCALER  .  53 

The  Computational  Subroutines  .  54 


Subroutine  SGENGy  .  54 

Subroutine  SNRCOM  .  54 

Subroutine  GRACEN  .  56 

Subroutine  WINDOW  .  57 

Subroutine  BISECT  .  59 

Discussion  of  Bisector  Location  .  61 

Discussion  of  the  Solution  to  the 

Simultaneous  Equations  .  67 

Subroutine  POINTS  .  69 

Subroutine  REGION  .  70 

Subroutine  PERROR  .  74 

Subroutine  EXACT  .  76 

Subroutine  CMPUTE  .  91 

Output  Subroutines  .  92 

Subroutine  PLOT .  93 

Subroutine  DECIDE  .  94 

Subroutine  OUTPUT  .  95 

Discussion  of  Matrix  IN .  96 

IV.  Program  Verification . .  .  99 

Introduction  .  99 

Manipulation  of  Signal  and  System 

Parameters . 100 

Sample  Problem  and  Initial 

Comparison . 100 

Variation  One:  Altering  Noise 

Energy . 104 

Variation  Two:  Altering  Signal 

Probabilities  .  106 

Variation  Three:  Deletion  of 

Signal . 113 

Variation  Four:  Addition  of  a 

Signal . 115 

Analysis  of  Integrated  Probability 

of  Error . 117 

Manipulation  of  Graphic  Display  .  119 

Translation . 119 

Rotation . 125 

Scaling . 125 

V.  Conclusions  and  Recommendations  .  131 


133 

134 


Bibliography  . 

Appendix  A:  Supporting  Derivations 
Appendix  B:  Flow  Charts  . 


142 


List  of  Figures 

Figure  Page 

1  Communication  System  Model  .  9 

2  Bisector  for  Equiprobable  Signals  .  62 

3  Bisector  for  Signals  Not  Equiprobable  ....  62 

4  Computation  of  Angle  of  Inclination, 

Case  1 .  64 

5  Computation  of  Angle  of  Inclination, 

Case  2 .  64 

6  Bisectors  and  Decision  Boundaries  for 

Sample  Signal  Set .  71 

7  Computation  of  Probability  Density  of 

Rectangular  Region  .  78 

8  Sample  Signal  Set  for  Explanation  of 

Subroutine  EXACT  .  80 

9  Translated  Sample  Signal  Set  .  81 

10  Diagram  of  Variable  Incrementing  Value  ....  86 

11  Organization  of  Matrix  IN .  98 

12  Quadriphase  Signal  Set  Used  For 

Verification  .  101 

13  Decision  Region  Boundaries  of 

Variation  Two . 109 

14  Decision  Region  Boundaries  of 

Variation  Two  With  Values  of  DELTA . 110 

15  Nine  Point  Signal  Set  for  Graphical 

Verification  .  120 

16  Decision  Region  Boundaries  of  Nine 

Point  Signal  Set . 122 

17  Translated  Nine  Point  Signal  Set . 123 

18  Rotated  Nine  Point  Signal  Set . 126 

19  Rotated  and  Translated  Nine  Point 

Signal  Set . 128 


vi 


List  of  Tables 

Table  Page 

I  Data  Input  Subroutines  .  46 

II  Computational  Subroutines  .  55 

III  Output  Subroutines  .  93 

IV  Distances  of  Signal  Set  Used  for 

Verification  .  103 

V  Statistics  of  Original  Signal  Set  Used 

for  Verification . 105 

VI  Statistics  of  Variation  One . 107 

VII  Statistics  of  Variation  Two . 112 

VIII  Statistics  of  Variation  Three  .  114 

IX  Statistics  of  Variation  Four . 116 

X  Verification  of  Integrated  Probability 

of  Error . 118 

XI  Statistics  of  Nine  Point  Signal  Set . 121 

XII  Statistics  of  Translated  Nine  Point 

Signal  Set . 124 

XIII  Statistics  of  Rotated  Nine  Point 

Signal  Set . 127 

XIV  Statistics  of  Rotated  and  Translated 

Nine  Point  Signal  Set . 129 


AIIT/G!:/LE/8in-39 


Abstract 

*  - 

The  purpose  of  this  project  was  to  design  a  tutorial 

aid  for  the  study  of  signal  detection  theory  and  its  appli¬ 
cation  to  communication  receiver  design.  An  interactive 
computer  program  was  developed  to  solve  problems  concerning 
the  detection  of  amplitude  and/or  phase  shift  keyed  signals 
in  the  presence  of  additive  white  gaussian  noise.  The 
probability  of  error  criterion  was  used  to  compare  and 
optimize  signal  set  parameters. 

,  The  user  may  input  from  2  to  33  two-dimensional 
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signal  vectors  ranging  in  amplitude  from  10  to  10  units, 
specify  signal  probabilities,  and  system  noise  energy.  The 
computed  system  and  signal  statistics  include  signal  energy, 
^  signal-to-noise  ratio,  Union  Bound  on  and  integrated  values 

of  probability  of  error,  noise  power  spectral  density,  and 
center  of  gravity.  Graphical  displays  provide  signal  set 
with  coordinates  and  decision  region  boundaries.  Modifica¬ 
tions  to  signal  set  may  be  performed  via  translation,  rota¬ 
tion,  or  scaling,  and  deletion  or  addition  of  signals. 

The  programming  language  used  was  FORTRAN  77  with 
graphical  capability  provided  thru  the  Tektronix  PLOT-10 
graphics  package.  The  program  (less  graphical  capability) 
may  be  executed  from  any  interactive  terminal  supported  by 
the  FORTRAN  77  compiler  and  the  International  Mathematical 

» 

ix 


k  Statistical  Libraries  (IMSL)  routines  MDNOR  and  MDBNOR . 


For  graphical  displays,  use  of  Tektronix  terminals  model 
4014,  4012,  or  4010  is  required. 
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ANALYSIS  OF  THE  OPTIMUM  RECEIVER 
DESIGN  PROBLEM  USING  INTERACTIVE 
COMPUTER  GRAPHICS 


I .  I n  t  roduc t i on 


Today  the  world  is  spanned  by  a  web  of  electrical 
circuits  that  permits  near  instantaneous  communication  over 
vast  distances.  The  tools  required  to  engineer  this  commun¬ 
ication  system  are  primarily  decision  and  estimation  theory. 
Some  sort  of  "message"  is  generated  at  a  source  which 
results  in  an  "observation"  at  a  receiver.  The  message  and 
observation  are  stochastically  related  and  the  objective 
is  to  determine  a  rule  which  forms  a  "best  guess"  of  the 
message  based  on  the  observation.  Of  primary  interest  in 
communication  theory  then,  is  a  method  of  distinguishing 
as  accurately  as  possible  a  transmitted  message  by  appro¬ 
priate  signal  processing  at  the  transmitter  and  deprocessing 
at  the  receiver. 

Even  though  the  foundations  of  detection  and  estima¬ 
tion  theory  are  relatively  recent  (initial  work  by  Wiener 
and  Rice  was  done  between  30  and  35  years  ago),  it  is  built 
on  solid  yet  complex  ground.  It  is  this  groundwork  that  all 
communication  engineers  must  appreciate  and  understand. 

While  the  mathematics  are  not  particularly  difficult,  the 
experience  of  countless  graduate  student  engineers  has 
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shown  that  the  application  and  basic  concepts  of  detection 
theory  are.  In  his  preface  to  Detection,  Estimation,  and 
Modulation,  Part  I.  (Ref  7:ix),  Harry  L.  VanTrees  states: 

Throughout  the  course  and  book  we  emphasize  the 
development  of  an  ability  to  work  problems.  Only  by 
working  a  fair  number  of  them  is  it  possible  to  appre¬ 
ciate  the  significance  and  generality  of  the  results. 

Because  the  solutions  to  these  problems  are  lengthy  and 

generally  consist  of  numerous  tedious  calculations,  many 

aspects  of  the  solutions  go  unnoticed  or  unrecognized. 

Additionally,  the  problems  most  often  must  be  restricted  to 

the  symmetric  or  standardized  cases.  Tools  to  facilitate 

working  these  problems  and  hence  assist  in  the  comprehension 

of  detection  theory  are  needed. 

Problem 

This  effort  is  directed  toward  the  creation  of  a 
tutorial  tool  to  assist  in  the  explanation  and  utilization 
of  signal  detection  theory.  The  ultimate  goal  is  the  devel¬ 
opment  of  an  interactive  computer  program  for  the  analysis 
of  communication  receiver  design  problems.  The  program  is 
intended  to  relieve  the  student  of  the  tedium  of  problem 
solving  thus  allowing  him  to  investigate  and  discover  how 
altering  the  signal  and  channel  parameters  affect  the  proba¬ 
bility  of  correctly  receiving  a  transmitted  message.  In 
order  for  the  student  to  better  visualize  the  problem  and 
and  its  solutions,  a  graphical  display  capability  is  to  be 
provided. 
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Scope 


The  signal  set  chosen  for  this  study  is  a  combina¬ 
tion  of  amplitude  shift  keyed  (ASK)  and/or  phase  shift  keyed 
(PSK)  signals.  The  program  user  will  be  able  to  input  the 
following  parameters: 

1.  Numb i  r  of  signals  to  be  analyzed 

2.  Vector  description  oi  each  signal 

3.  Probability  of  each  signal 

4.  Power  spectral  density  of  system  noise 

After  analysis,  the  following  signal  and  system  statistics 
will  be  provided  as  output: 

1.  Individual  signal  energies 

2.  Total  energy 

3.  Center  of  gravity  of  signals 

4.  Display  of  signal  set  and  decision  regions 

5.  Conditional  probability  of  error 

6.  Total  probability  of  error 

Additionally,  the  user  will  be  able  to  modify  the  signal 
set  by: 


1.  Translation  and/or  rotation  of  signal  set 

2.  Altering  original  signal  set  by  deleting, 
adding,  and/or  moving  signals 


Assumptions  and  Limitations 

The  theoretical  complexity  and  nature  of  the  problem 
demand  that  several  assumptions  be  made. 

1.  The  actual  decision  boundaries  of  any  particular 
signal  set  depend  on  the  a  priori  probabilities  of  the  sig¬ 
nals,  the  signals  themselves,  and  the  specifications  of  the 
channel  transitional  probabilities.  The  case  in  which  the 
channel  disturbs  the  signal  vector  by  adding  to  it  a  random 
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noise  vector  will  be  the  sole  channel  considered.  The 
reasonable  assumption  that  noise  and  signal  components  are 
statistically  independent  is  used. 

2.  In  order  to  simplify  the  decision  function,  the 
probability  density  of  the  noise  component  must  be  specified. 
In  this  project,  the  noise  is  considered  Id  ix  white  gaus- 

si  an  . 

3.  In  formulating  the  optimum  receiver  design,  it 
is  assumed  that  the  signals  being  transmitted  and  their 
probabilities  are  known  at  the  receiver. 

Approach  and  Presentation 

In  order  to  accomplish  this  task,  three  essential 
requirements  were  identified.  The  first  was  a  good  under¬ 
standing  of  detection  theory  and  the  second  was  an  adequate 
understanding  of  computer  programming  and  computer  graphics. 
Melding  these  two  initial  requirements,  a  program  was  pro¬ 
duced  which  culminated  in  the  third  and  final  requirement. 
This  last  requirement  then  is  the  necessity  for  verifying 
that  the  program  works  as  desired. 

We  begin  in  Chapter  II  by  summarizing  the  theory  of 
detection  needed  for  the  design  of  the  program.  Initially, 
we  classify  the  detection  problem  and  further  delineate  the 
assumptions  used.  Discussions  of  decision  rules,  the  proba¬ 
bility  of  error  criterion,  and  the  general  gaussian  problem 
provide  the  required  fundamentals.  A  more  in-depth  study  is 
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given  in  the  following  sections  on  the  analysis  of  multiple 
signals  and  the  application  of  the  Union  Bound. 

With  the  basic  concepts  assumed,  we  move  to  Chapter 
III,  "Concept  and  Design  of  the  Software."  Modular,  top- 
down  structured  design  was  used  throughout  the  program.  The 
in  prog  r  basically  consists  of  eleven  calls  to  subrou¬ 
tines  or  modules,  which  operate  on  the  inputted  data.  Twelve 
other  subroutines  are  user  initiated  for  problem  analysis, 
variation,  and  output  display.  As  nearly  as  possible  during 
the  design  phase,  as  each  subroutine  was  completed,  it  was 
integrated  into  the  main  and  validation  tests  run.  The 
chapter  begins  with  an  overview  of  the  program  operation  and 
then  discusses  the  function  and  design  of  the  individual 
subroutines . 

In  order  to  verify  the  program,  several  approaches 
could  have  been  pursued.  As  Chapter  IV  explains,  the  pro¬ 
cedure  used  here  is  the  comparison  of  solutions  of  several 
typical  problems.  First  the  hand  calculated  result  is 
explained  and  then  the  program  generated  solution  presented 
and  compared. 

The  concluding  chapter  contains  a  discussion  of 
these  results  and  areas  for  possible  improvement  or  extension 
of  capability. 
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1 1 .  Theory  of  Detection 


Introduction 

The  reception  of  signals  in  noise  presents  problems 
of  significant  importance  in  the  theory  of  communications, 
since  noise  to  varying  degr-  •_  t.  always  obscures  the  desired 

signal  or  message.  Because  the  observation  period  during 
which  the  signal  may  be  recovered  is  necessarily  limited 
and  because  of  the  inherently  statistical  character  of  sig¬ 
nal  and  interference,  information  is  lost  and  recovery 
incomplete.  Of  course,  reception  of  signals  under  such 
conditions  can  usually  be  carried  out  in  a  variety  of  ways, 
but  very  few  of  these  possess  optimum  properties.  The 
reception  problem  may  then  be  described  as  the  task  of  find¬ 
ing  "best",  or  optimum,  systems  in  order  to  remove  the 
deleterious  effects  of  the  accompanying  noise. 

In  communication  theory,  the  reception  problem  is 
separated  into  two  distinct  fields.  When  the  number  of 
possible  signals  is  finite,  the  problem  is  called  a  "deci¬ 
sion"  or  "detection  problem."  If  the  number  of  signals  is 
uncountably  infinite,  the  problem  is  referred  to  as  an 
"estimation  problem." 

Furthermore,  reception  is  distinguished  by  the  fact 
that  the  receiver  has  only  a  limited  knowledge  of  the  input 
signal  (necessarily  so,  if  any  information  is  to  be  conveyed) 
and  little  or  no  control  over  it.  In  other  words,  the 
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judgement  required  about  the  input  must  be  a  statistical 
inference.  This  suggests  the  application  of  statistical 
decision  theory  for  the  design  of  optimum  reception  systems. 
Of  primary  importance  is  the  criterion  of  excellence  by 
which  the  performance  of  a  reception  system  can  be  rated 
and  v. :  : respect  to  which  the  optimization  can  )  •  carried 
out.  Once  the  criterion  is  selected,  the  optimum  system  is 
in  principle  determined.  As  mentioned  in  the  introduction, 
many  "optimum"  criteria  have  been  developed  and  the  bulk  of 
this  chapter  will  be  devoted  to  establishing  the  criterion 
upon  which  this  project  is  based. 

In  order  to  attack  a  problem  by  statistical  decision 
theory,  we  must  have  certain  information  available  before¬ 
hand.  We  must  have,  for  example,  the  statistics  of  the 
noise  and  if  possible  the  statistics  of  the  signals.  The 
less  we  assume  known  concerning  these,  the  more  difficult 
is  the  solution  in  general,  and  the  more  general  the  solu¬ 
tion.  To  justify  the  selection  of  the  particular  criterion 
used  and  to  provide  the  reader  with  necessary  terminology 
and  background,  a  discussion  of  the  theoretical  approach  to 
the  problem  will  be  presented. 

Classifying  the  Detection  Problem 

The  problem  of  the  detection  of  a  signal  in  noise  is 
equivalent  to  one  which,  in  statistical  terminology,  is 
called  the  problem  of  "testing  hypothesis."  Here,  the 
hypothesis  that  the  noise  alone  is  present  is  to  be  tested, 
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on  the  basis  of  some  received  data,  against  the  hypothesis 
(or  hypotheses)  that  a  signal  (or  one  of  several  possible 
signals)  is  present. 

Detection  problems  can  be  classified  in  a  number  of 
ways:  by  the  number  of  possible  signals  which  need  to  be 

distinguish*  d .  by  the  natur*.  uf  the  hypothesis  or  dec i.- :  >n 
rule,  by  the  nature  of  the  data  and  their  processing,  and 
by  the  characteristics  of  the  signal  and  noise  statistics. 
Each  of  these  classifications  is  discussed  below  and  where 
appropriate,  the  assumptions  used  throughout  this  presenta¬ 
tion  will  be  addressed. 

1.  Number  of  Signals  to  be  Distinguished.  The 
number  of  signals  to  be  distinguished  is  equal  to  the  number 
of  hypotheses  to  be  tested.  In  "binary  detection,"  one  can 
make  but  two  decisions,  corresponding  to  the  two  hypotheses, 
while  a  "multiple  alternative  detection  system"  makes  more 
than  two  decisions.  The  class  of  all  possible  (desired) 
system  inputs  is  called  the  "signal  class  or  set"  and  is 
conveniently  represented  as  an  abstract  space  in  which  each 
point  corresponds  to  an  individual  signal.  The  set  of 
possible  signals  is  known  as  the  signal  space  which  is 
denoted  by  S.  Thus,  we  can  write: 

S  *  (s^  s2,  .....  sk>  or 

S  =  (s1(t),  s2(t),  .....  sk(t)} 
where  ke(2,  3 . .  33}  for  this  project. 


A  signal  is  a  desired  system  input.  Noise  is  an  undesired 
system  input.  The  noise  is  considered  to  enter  the  system 
independently  of  the  signal  and  to  affect  each  observation 
according  to  the  method  whereby  the  two  are  combined.  The 

v.:  '  ::  !..•  t  hod  u :  i  1  i  zed  here  is  addition,  i  .  the 

observed  signal  has  been  perturbed  by  additive  noise  only. 
Thus,  if  the  noise  is  denoted  by  n  [or  n(t)]  .  we  model  the 
system  as  shown  below. 


n(t) 


Fig  1.  Communication  System  Model 

3 .  The  Nature  of  the  Data  and  Their  Processing. 

The  observation  made  on  the  mixture  of  signal  and  noise 
during  the  observation  period  may  consist  of  a  discrete  set 
of  values  (discrete  or  digital  sampling)  or  may  include  a 
continuum  of  values  throughout  the  interval  (continuous  or 
analog  sampling).  Whichever  procedure  is  used  is  a  charac¬ 
teristic  of  the  problem.  The  set  of  possible  observations 


make  up  the  observation  space,  Z,  where 

Z  =  {z1,  Zg,  .  .  .  .  ,  z^}  or 
Z  =  {zx(t) ,  z2(t) ,  - ,  zR(t)} 

Similarly,  it  is  of  interest  whether  or  not  the 
observation  interval,  i.e.,  the  interval  over  which  the 
reception  system  can  store  the  data  for  analysis,  is  fixed 
or  variable.  In  the  latter  case,  one  can  consider  "sequen¬ 
tial"  detection.  In  applications  of  decision  theory,  it 
turns  out  that  the  analysis  divides  conveniently  at  the 
choice  between  the  sequential  and  the  nonsequential.  For 
the  purpose  of  this  project,  the  observations  may  include  a 
continuum  of  values;  however,  only  the  nonsequential  case 
will  be  considered. 

4.  The  Signal  and  Noise  Statistics.  The  nature  of 
these  quantities  is  clearly  of  central  importance,  as  it  is 
upon  them  that  specific  calculations  of  performance  depend. 
The  signal  itself  may  be  described  in  quite  general  terms 
involving  both  random  and  deterministic  parameters.  No 
restriction  is  placed  on  the  signal  other  than  that  it  have 
finite  energy  in  an  observation  interval;  it  may  be  entirely 
random,  partly  random,  or  entirely  deterministic.  The 
description  of  the  noise  is  necessarily  statistical,  and 
usually  distinguished  between  noise  belonging  to  "stationary" 
and  "nonstationary"  processes.  As  may  be  expected,  it  will 
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be  assumed  here  that  the  signals  being  transmitted  and  their 
probabilities  are  known  at  the  receiver.  The  noise  will  be 
considered  to  consist  of  independent,  identically  distributed, 
zero  mean,  gaussian  random  variables,  each  with  identical 
variance,  i.e.,  white  gaussian  noise.  Additionally,  the 
reasonable  assumption  that  the  noise  and  signal  are  statis¬ 
tically  independent  will  be  used. 

The  Decision  Rule 

As  previously  mentioned,  the  objective  of  the 
receiver  is  to  take  the  observation  and,  using  some  prede¬ 
termined  rule,  make  a  "best  guess"  at  the  transmitted  mes¬ 
sage  or  signal .  A  brief  discussion  of  this  vital  concept  is 
necessary  at  this  point,  because  it  is  this  rule,  known  as 
the  "decision  rule,"  d(z),  that  maps  the  observation  space, 

Z,  into  the  decision  space,  D,  in  some  optimal  manner.  With 
the  assumption  that  one  of  a  finite  set  of  signals  is  trans¬ 
mitted,  the  mapping  d:  Z-*-D  is  a  partitioning  of  the  obser¬ 
vation  space  into  "decision  regions"  corresponding  to  each 
element  of  Z.  For  example,  for  the  binary  signal  set,  the 
mapping  is  equivalent  to  dividing  Z  into  two  "decision 

regions,"  Z^  and  Z2  such  that  d(z)  =  d^  if  z,  the  obser¬ 
vation,  is  an  element  of  region  Z^  and  d(z)  =  d2  if  z  is 

an  element  of  region  Zg.  The  regions  Z^  and  Z2  must  be 

disjoint  in  order  that  each  point  in  Z  will  yield  a  unique 
decision.  Additionally,  Z^  and  Z2  must  cover  Z, 


(Zx  U  Z2  =  Z),  in  order  that  each  point  in  Z  will  have  a 
decision  associated  with  it. 

As  an  example  of  a  simple  decision  rule,  the 
"Maximum-Likelihood  Decision  Criterion"  will  be  developed. 

The  basic  concept  of  the  maximum  likelihood  criterion  is  to 
select  the  decision  corresponding  to  the  message  which  is 
the  most  likely  to  have  caused  the  observed  signal.  This 
technique  requires  knowledge  of  the  conditional  probability 
density  functions  of  the  observation  given  each  of  the  pos¬ 
sible  messages,  that  is,  p(z|m).  For  the  binary  case,  the 
criterion  becomes:  "Given  an  observation  z  e  Z  ,  let 
d(z)  =  d^  if  it  is  more  likely  that  m^  generated  z  than 
that  m2  generated  z"  (Ref  3:22). 

Mathematically  speaking,  the  decision  rule  takes  on 
the  following  form: 

{d1  If  p(z|m1)  >  p(z|m2) 

d2  If  p(z|m2)  >  p( z | m^)  (1) 

Therefore,  given  a  particular  observation  zQ,  one  may 
compute  p(zo|m^)  and  p(z0|m2)  and  apply  the  decision  rule  of 
Eq  (1)  to  determine  the  transmitted  signal.  It  should  be 
noted  that  no  assignment  has  been  made  when  p(z|m^)  = 
p(z|m2)  .  The  values  of  z  for  which  the  conditional  densi¬ 

ties  are  equal  may  be  arbitrarily  assigned  to  either  d^  or 
d2  since  and  m2  are  equally  likely  to  have  been  the  cause 


of  the  observed  z. 


Sometimes  the  application  of  a  decision  rule  can  be 
simplified  by  performing  mathematical  operations  on  the 
conditional  densities.  As  previously  noted,  an  equivalent 
method  for  representing  the  decision  rule  of  Eq  (1)  is  to 
define  the  decision  regions  Z^  and  Z2  as: 

Z1  =  { z  :  p{ z j m^ )  >  p(z[m2)} 

Z2  =  {z  :  p(z|m2)  >  p(z|m1)}  (2) 

If  the  "Likelihood  Ratio"  A(z)  is  defined  as 

p(z|m2) 

A(z)  ”  p(z|m1)  (3) 

then  and  Z2  may  be  defined  as: 

=  {z  :  A(z)  <  1} 

Z2  =  {z  :  A(z)  >  1}  (4) 

Using  shorthand  notation,  the  decision  rule  becomes: 

d2 

A ( z)  J  1 

dj  (5) 

One  may  operate  on  the  likelihood  ratio  expression  as  long 
as  the  unique  ordering  of  A(z)  relative  to  unity  is  main¬ 
tained.  The  natural  logarithm  is  quite  often  a  useful 
operator  especially  for  gaussian  problems. 
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The  decision  rule  has  thus  become  a  simple  method 
of  assigning  a  message  value  to  each  received  observation. 

It  sets  an  easily  implemented  threshold  which  a  receiver 
can  use  to  decide  which  signal  was  transmitted. 

Discussion  of  the  Probability  of  Error  Criterion 

It  was  mentioned  in  the  introduction  that  several 
different  criteria  have  been  developed  to  form  different 
types  of  decision  rules.  Before  presenting  the  particular 
criterion  to  be  used  in  this  project,  it  is  necessary  to 
introduce  some  definitions  and  notation.  For  ease  of  expla¬ 
nation,  the  discussion  will  consider  the  binary  case 
initially,  and  appropriate  references  to  the  multiple  deci¬ 
sion  case  will  be  interjected. 

In  dealing  with  the  binary  decision  problem,  there 
are  two  types  of  errors  that  one  can  make.  First,  one  may 
decide  d2  when  m^  is  true,  and  second,  one  may  decide  d^ 
when  m2  is  true.  Each  of  these  errors  has  a  probability 
associated  with  it  which  depends  on  the  decision  rule  and 
conditional  densities.  The  following  notation  will  be 
employed: 

P{d2|m:,}  =  Probability  of  making  decision  d2  when 
is  true 

P{d1|m2}  =  Probability  of  making  decision  d1  when  m2 
is  true 


In  addition  to  two  errors,  there  are  also  two  correct 
decisions  that  one  can  make  in  the  binary  decision  problem. 
One  may  decide  d^  when  is  true  and  one  may  decide  d2  when 
m2  is  true.  Again,  these  correct  decisions  have  associated 
probabilities  represented  by: 

P{d^|m^}  =  Probability  of  making  decision  when 
is  true 

P{d9|m„}  =  Probability  of  making  decision  d„  when 
m2  is  true  " 

The  probability  P{d2|m^}  is  sometimes  referred  to  as 
the  "false-alarm  probability,"  or  in  terms  of  statistical 
decision  theory,  as  the  "level  of  significance."  The  prob¬ 
ability  P{d2|m2)  is  sometimes  referred  to  as  the  "detection 
probability"  or  as  the  "power  of  the  test."  Finally, 

Pld-jj'nig}  is  referred  to  as  the  "miss  probability." 

This  notation  will  be  used  throughout  this  project 
as  it  is  simple  and  compact,  yet  complete.  Where  necessary, 
specific  probability  densities  and/or  subscripts  will  be 
added  to  prevent  ambiguity. 

The  decision-rule  to  be  used  is  known  as  the  "Mini¬ 
mum  Probability  of  Error,"  Pe>  criterion  which  can  be 
defined  as: 

Pg  =  P{making  an  incorrect  decision} 

=  P{decide  d2  when  m^  is  true  or  decide  d^  when 
m2  is  true} 

=  P{(d2  and  m^)  or  (d^  and  m2)} 
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The  probability  of  error  criterion  says  to  select 
the  decision  regions  so  as  to  minimize  this  total  probabil¬ 
ity  of  error.  Realizing  that  the  messages  m^  and  rag  are 
mutually  exclusive  and  using  conditional  probabilities,  the 

P  can  be  written: 
e 

Pg  =  P{d2|m1}  Pfn^}  +  PfdjJrrig}  Pfnig}  (6) 

Here,  P{m^}  and  P{mg}  are  the  a  priori  probabilities  and 
represent  the  probability  that  message  will  be  the  mes¬ 
sage  selected  for  transmission.  Since  and  m2  thru  m^  are 

mutually  exclusive  and  exhaustive,  it  must  be  that 


P{m^}  +  P{m2)  +  ....  +  P{m^}  =  1 

When  Pfn^}  =  P{n)g}  =  ...==  P{mk)  ,  the  signal  set  under 

study  is  referred  to  as  the  "equally  likely  message"  case. 

In  order  to  select  the  decision  regions  to  minimize  the  P0, 

one  must  be  able  to  write  P„  in  terras  of  the  decision 

e 

regions.  For  the  binary  case,  we  begin  with  Zg.  Once  Zg  is 
specified,  Z^  is  automatically  described  and  one  minimizes 
Pe  by  selecting  only  those  observations,  z,  which  should  be 
in  Zg  as  message  mg.  For  example, 


P{d1|rag}  =  f  p(z|m2)dz 
zi 


(7) 


which  says  that  the  probability  of  error,  i.e.,  deciding  d^ 
given  m2  can  be  found  by  integrating  the  conditional 
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probability  p(z|m2)  over  the  bounds  or  region  of  .  Since 
P{d1|ra2)  +  Ptdglnig}  =1  ,  it  follows  that: 

P{d1|m2}  =  1  -  /  p(z|m2)dz  (8) 

z2 

Similarly,  one  can  write 

P{d2(m1}  =  /  p(zjm1)dz  (9) 

Z2 

It  is  easily  shown  (Ref  3:39),  that  in  order  to  minimize  the 
probability  of  error,  Eq  (3)  repeated  below  is 

p(z | m2) 

~  pCzliDj)  (10) 

used  to  provide  a  mathematical  description  of  the  decision 
regions  as 


P{m.. } 

’  u  :  A(z>  ”  PI5TT  ’ 


=  { Z 


P{m1 } 

A<z>  <  rajr  1 


and  correspondingly  the  decision  rule, 


A(z) 


^2  P{m1> 
<  P{m2> 


(11) 


(12) 
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Here  again,  the  decision  rule  consists  of  comparing  the 
likelihood  ratio  to  a  threshold;  however,  the  threshold  is 
determined  by  the  ratio  of  the  a  priori  probabilities. 

The  probability-of-error  decision  rule  has  another 
interesting  interpretation.  Consider  the  general  rule  given 
above  written  as  follows: 


p(z|m2)  d2  P{m1) 

p( z | m1 )  <  P{m2)  (13) 


Multiplying  both  sides  of  this  expression 
obtains 


P(m2> 
by  P (m1 } 


one 


p(z|m2)  P{m2)  d2 
p(zim1 )  pTmjJ'  < 


(14) 


By  using  the  mixed  Bayes  rule,  this  can  be  rewritten  as 
P(ra2|z)p(z)  P(m2|z)  d2 

P(m1 | z)p(z)  ”  P(m1|zj  <  1  (15) 

dl 

This  result  says  to  decide  d^  if  P(m1jz)  >  P(m2|z)  and 
decide  d2  if  P(m2|z)  >  P(m^|z)  .  In  other  words,  one  should 

select  the  decision  corresponding  to  the  message  with  the 
larger  a  posteriori  probability,  i.e.,  the  probability  of  m^ 
given  z.  Hence,  the  probability-of-error  criterion  is  iden¬ 
tical  to  the  maximum  a  posteriori  (MAP)  decision  criterion 
stated  as  follows:  Given  an  observation,  z,  select  d^  if 


18 


m^  is  more  likely  than  mg.  The  key  feature  of  this  decision 
situation  is  that  p(z|m)  becomes  a  rule  for  making  the  deci¬ 
sion,  d,  from  a  posteriori  data  alone,  i.e.,  without  know¬ 
ledge  of  or  dependence  upon  the  particular  message,  m,  that 
resulted  in  the  observation  z.  The  a  priori  knowledge  of 
the  signal  set  and  the  signal  distribution  is  built  into  the 
optimum  decision  rule.  Thus,  the  decision  rule  becomes  the 
mathematical  embodiment  of  the  physical  system  used  to  pro¬ 
cess  the  data  and  yield  decisions . 

The  Concept  of  the  Sufficient  Statistic 

In  order  to  broaden  the  class  of  binary  decision 
problems  to  include  those  where  the  observation  is  more 
complicated  than  a  single  scalar,  the  maximum  likelihood 
function  A(z)  becomes  a  function  of  a  vector  rather  than  a 
scalar.  That  is 

p(z|m2)  d2 

A(^>  -  piirify  <  x 

di 

where  the  value  of  X  is  determined  by  the  particular  deci¬ 
sion  criterion.  One  must  now  consider  more  than  one  obser¬ 
vation,  but  the  probabil ity-of-error  criterion  continues  to 
be  just  a  likelihood  ratio  test.  All  that  needs  to  change 
is  that  the  integrals  over  the  decision  regions  now  become 
I-fold  integrals  rather  than  simple  one-dimensional  integrals. 
Hence,  regardless  of  the  dimensionality  of  the  vector  z,  the 
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decision  rule  can  be  formulated  as  a  threshold  test  on  the 


3 


likelihood  ratio  A(z).  Since  the  decision  rule  is  a  mapping 
from  the  observation  space  Z  to  the  decision  space  D,  any 
operator  on  z  that  produces  the  same  mapping  can  be  used  as 
a  decision  rule.  A  "sufficient  statistic"  is  defined  as  a 
function  >(z)  such  that  any  likelihood  ratio  decision  rule 
d(z)  can  be  written  as  a  function  of  £(z)  (Ref  3:64).  The 
concept  of  the  sufficient  statistic  can  be  quite  useful  in 
simplifying  decision-rule  implementation  and  analyzing  sys¬ 
tem  performance.  It  must  be  noted  that  since  the  threshold 
in  the  likelihood-ratio  test  can  take  on  any  value,  and 
since  a  sufficient  statistic  must  be  able  to  mirror  this 
test,  it  must  be  possible  to  determine  the  value  of  the 
likelihood  ratio  from  the  sufficient  statistic.  In  other 
words,  it  provides  enough  information  about  the  observation 
to  enable  a  decision  to  be  made. 

Discussion  of  the  General  Gaussian  Problem 

Several  approaches  could  be  taken  to  extend  the 
development  of  detection  theory.  As  mentioned  earlier,  there 
are  numerous  classifications  of  the  detection  problem,  and 
in  order  to  solve  a  particular  problem,  specific  assumptions 
are  generally  made.  In  lieu  of  examining  each  of  these 
cases  individually,  the  general  gaussian  problem  will  be 
solved  and  then  the  assumptions  used  in  this  project  and 
described  earlier  will  be  applied.  In  this  manner,  the 


validity  and  generality  of  the  assumptions  can  be  high¬ 
lighted.  The  only  constraint  will  be  that  the  conditional 
probability  density  function  of  the  observation,  z,  be 
gaussian . 

The  general  form  of  the  density  function  of  an  Ith- 
order  gaussian  vector,  z,  with  mean,  s,  and  variance  matrix, 
V ,  is 


p(z)  = 


(2tt) 


1/2 


(det  V) 


I  exp 


1  T  -1 

-  -g(z  -  s)x  v  (z  -  s) 


(16) 


where  it  is  assumed  that  V  is  positive  definite  and  symmet¬ 
ric  (Ref  3:69).  The  components  of  s  are  the  expected  values 
of  the  components  of  z: 


E{z±}  =  si  For  i  =  1,2, ... ,1 


The  elements  of  V  are  the  covariances  of  z.  and  z.: 

vij  *  E  {<zi  -  si  >  (zj  -  sj  >  1 

=  cov(zjL,  z  j  )  For  i  ,  j  =  1,2,...,  I 

Since  the  random  variables,  z^  are  jointly  gaussian,  the 
conditional  densities,  p(zjm1)  and  pCzjnig)  can  be  written: 


P(zfmi)  =  - - r 

1  (  2tt  ) A  (det  V1)s 

exp  |-  -|(z  -  s1  )T  V1_1  (z  -  Sj^) 


(17) 
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and 


P(z|m2) 

exp 


_ 1 _ 

(2tt)I/2  (det  V2)4 

-  | (z  "  s2)T  V2  (z  -  s2) 


(18) 


The  likelihood  ratio  is  therefore 


(det  V^)2  exi) 

-  i(z  -  s2)T  V2  1  (z  -  s2) 

1 

(det  exp 

1/  *T  „  -1  / 

-  2(z  -  s1)  (z  -  s1) 

(19) 

And  as  before,  the  likelihood  ratio  test  is 


A(z) 


(20) 


By  appropriately  assigning  the  value  of  X,  any 
threshold  test  can  be  performed.  In  order  to  show  this,  the 
logarithm  of  Eqs  (19)  and  (20)  is  taken  and  the  likelihood 
ratio  test  for  the  general  gaussian  problem  becomes 

(z  -  Vf1  (z  -  s^ 


-  (z  - 


T  -1 
^  —2 


®2) 


< 

d. 


21nX  +  In 


det  Vg 
det  V1 


(21) 


In  this  most  general  form,  Eq  (21)  is  difficult  to 
evaluate;  hence,  the  necessity  for  making  the  various 
assumptions.  Whenever  the  noise  is  independent  of  the 
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signal  being  sent,  the  assumption  of  equal  covariance 
matrices  is  valid.  That  is, 


v  =  V  =  V 
-1  -2  - 


Equation  (21)  is  thus  simplified  to 


(z  -  s1)T  V"1  (z  -  sx) 


-  (z  -  s2)T  V  1  (z  -  s2)  J  21nX  (22) 


In  order  to  determine  the  sufficient  statistic,  the 
matrices  are  multiplied  out  and  the  common  terms  combined  as 
follows : 

We  begin  with  the  first  term  of  Eq  (22),  which  becomes 

<z  -  s1)T  V"1  (z  -  s1)  =  (zT  V'1  -  sxT  V  1 ) ( z  -  sx) 

T  -1  T  -1 

=zVz-s1Vxz 

T  ,,-l  ^  T  „-l 

-  z  V  sx  +  st  V  sx 

Similarly,  for  the  second  term 

T  -1  T  -1  T  -1 

(z  -  s2)  V  (z  -  s2)  =  z  V  z  -  s2  V  z 

T  „-l  .  T  ,.-l 

-  z  V  s2  +  s2  V  sx 

Substituting  back  into  Eq  (22),  combining  like  terms,  and 
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using  matrix  algebra  to  simplify,  yields 


^2 

Hz)  =  (£2  ~  -l)T  -_1  -  <  lnX 

dl 

+  Hs2T  v'1  s2  -  s1T  v-1  Sj]  =  X’  (24) 

Now  since  £( z)  is  a  linear  combination  of  jointly 
gaussian  random  variables,  it  is  in  fact  gaussian,  and 
determining  its  statistics  requires  knowledge  of  only  its 
mean  and  variance.  Taking  the  expected  values  and  perform¬ 
ing  normal  operations  yields  the  relations  below  for  the 
necessary  statistics.  The  complete  derivations  of  these 
quantities  can  be  found  in  Appendix  A.  By  defining  As  as 
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I 

I 


I 


Similarly,  given  that  m 2  is  true,  gives 


EU|m2}  =  AsT  V"1  s2 


As  stated  previously,  the  probability  of  false  alarm  is 
given  by: 


(27) 


Ppa  =  PtdJm 


S-f 


—  *  i  i  j  —  j  p ( .2, 1  m ^  )  d£ 

A  ’ 


(9) 


From  the  preceding  results  (e.g.,  Eq  (17)),  we  know  that 
p(5,|m1)  can  be  written 


P(£|m^)  T  rK  r 

X  ( 2tt )^  (AS1  V  1  As)* 

By  substitution,  we  obtain: 


exp 


( £  -  AsT  V"1  sx)2 
AsT  V-1  As 


(28) 


FA 


-  r  .  1 

/,  (2ti)4  ( AsT  V  1 


As) ' 


exp 


(£  -  AsT  V  1  s1)2 
As  V"1  As 


dfc  (29) 


This  expression  can  be  simplified  to  become 


PFA  "  Q 


InA 

( AsT  V  1  As)4 


(AsT  V  1  As)~ 


(30) 


where  the  function  Q(  )  is  related  to  the  error  function  and 
defined  as  in  Ref  (10:49). 
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As  before,  the  derivation  of  this  simplification  is  located 
in  Appendix  A. 

If  we  now  define 

2  „  t  -1 
5^  =  As1  V  As 


the  nrobability  of  false  alarm,  Pv..  can  be  written 

A 


PFA  "  P{d2!ml}  =  Q 


(31) 


And  the  probability  of  detection,  P^,  can  be  written 


(32) 


If  the  variance  matrix,  V,  is  a  product  of  a  scalar, 
v,  and  the  identity  matrix,  _I,  (i.e.,  independent  noise 
components  with  different  variances),  the  problem  becomes 
similar  to  the  one  used  in  this  project.  That  is,  the  prob¬ 
lem  models  the  addition  of  an  independent  gaussian  noise  of 
variance,  v,  to  each  component  of  s.  The  sufficient  statis¬ 
tic  becomes 

£(z)  =  i  AsT  z  (33) 


and  the  squared  distance  becomes 

*2  .  ||  As  ||  2 

v  (34) 
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2 

The  appearance  of  v  in  the  demoninator  of  6  indi¬ 
cates  that  the  performance  of  a  system  would  decrease  as 

v  increases.  Hence,  the  system  performance  is  determined  by 

2  2 

the  ratio  of  ||  As  |J  to  v.  If  j|  As  |]  is  taken  as  a  measure 

2 

of  signal  energy,  then  c  becomes  a  measure  of  the  signal- 
tn-nnisi  rati'  (  He  f'  3:72). 

Equations  (31),  (32),  (33),  and  (34)  thus  become 
the  theoretical  basis  for  th«  remainder  of  the  project. 

Given  the  signal  and  noise  statistics  and  energies,  a  suf¬ 
ficient  statistic  can  be  determined  and  compared  against  a 
given  threshold  to  provide  a  solution  to  the  decision  rule. 
Additionally,  these  same  values  allow  computation  of  the 
probabilities  of  error  to  be  used  as  a  basis  for  optimizing 
a  particular  solution. 

Decision  Rule  for  Multiple  Signals 

In  order  to  extend  these  results  to  the  multiple 
decision  case,  the  following  assumptions  are  made: 

1.  The  message  space,  M,  consists  of  K  messages, 

i .  e .  ,  M  —  {m^  ,  mg ,  .  .  .  ,  }  . 

2.  The  signal  space,  S,  consists  of  K  signals, 

i.e.,  S  =  {s^,  Sg,  ...,  s^}  ,  where  there  is  a  one  to  one 

mapping  between  M  and  S. 

3.  The  decision  space,  D,  consists  of  J  elements, 

i.e.,  D  =  {d^,  dg,  d ^ }  ,  where  J  is  usually  equal  to 

K,  but  this  is  not  a  necessary  condition. 
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4.  The  observation  space,  Z,  will  be  partitioned 

J 

into  J  regions  such  that  (^Jz.  =  Z  ,  Z.f^jz,  =  <f>  for 

J=1  3  3  k 

all  j^k,  and  if  z  is  an  element  of  Zy  the  decision,  d,  will 

be  denoted  bv  d . . 

3 

The  probab  i  !  :  t <  >  f  i  rror  c  r  ;  5 1  r  i ;  -n  e;  !••.  Cvui:-'  i  d>  red 

a  subset  of  the  Bayes  Decision  Criterion.  The  Bayes  cri¬ 
terion  employs  a  systematic  procedure  of  assigning  a  "cost" 
to  each  correct  and  incorrect  decision  and  then  minimizes 
the  total  average  cost.  Associated  with  each  message,  m^, 

and  decision,  d  . ,  there  is  a  unique  cost,  C.,,  which  is 
J  JK 

defined  as  the  cost  of  deciding  d.  given  the  message  was 

J 

m^.  By  utilizing  this  concept  of  "cost”,  the  minimization 
of  the  probability  of  error  can  be  achieved.  The  Bayes 
cost  or  risk  becomes  the  expected  value  or  average  cost 
associated  with  a  particular  problem.  Mathematically,  this 
is 


B  -  Elcjk> 


From  the  definition  of  expected  value,  this  becomes 


b  -  X  cjk  p{do  ■  v 


J  K 

I  I  C  P{d.|m.}  P{m  } 
j=l  k=l  3  K  K 


(35) 
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By  substitution  of  Eq  (9)  into  Eq  (35),  the  Bayes  risk  can 
be  rewritten 

B 

Tnk  j  ng  t  hi-  su: 

J  K 

B  =  I  /  Z  C  ,  Prm  }  p(z|m,  )  dz 

j  =  l  Z.  k=l  -1K  K  k  -  (37) 

The  Bayes  criterion  says  to  select  the  decision  regions  Z., 

J 

j  =  1,  2,  J  such  that  the  average  cost  or  risk  is 

minimized.  It  can  be  shown  (Ref  3:97,98)  that  B  is  mini¬ 
mized  by  selecting  Z.  such  that  z  is  an  element  of  Z .  if 

J  J 

K  K 

£  Cjk  P{rak}  P(z|mk)  <  Z  C^k  P{mk)  p(z|mk)  (38) 

k  1  k=l 

for  all  Ifj . 

If  we  require  that  the  number  of  messages  be  equal 
to  the  number  of  decisions  and  that  there  be  a  logical 
pairing  of  message  hk  to  decision  d^,  several  simplifications 
to  Eq  (38)  can  be  made.  Since  we  are  concerned  with  the 
probability  of  error  criterion,  we  will  assume  probability 
of  error  costs  given  by 

0  If  j  =  k 

cjk  * 

1  If  j  t  k 


K 


Z  Z  C  ,  p{m,  }  /  p ( z | m.  )  dz 

j=i  k=i  k  z.  k 


(36) 


;.ion  over  K  inside  the  integral  .  w<  have 
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Substituting  this  into  Eq  (38),  we  find  that  z  will  be  an 
element  of  Z.  if 


K  K 

£  P{m.  }  p(  z  I  m.  )  <  £  P{m,  }  p(z|m  ) 

k  =  l  k  k  k=l 

k?U  k^  ? 


(39) 


lor  ail  '^k.  V.'e  note  that  the  sums  on  both  sides  ui  Eq  (39) 
are  identical  except  that  a  different  term  is  missing.  If 
we  add  and  subtract  P{m^}  p(z|nm)  on  the  left  hand  side  of 
Eq  (39)  and  add  and  subtract  Pfm^}  p(z|m£)  on  the  right 
hand  side,  we  have 


K 

£  p{mk)  P(z|mk)  “  P^mj^  P(zlmj) 


K 


<  £  P{mk)  P(z|nik)  -  P{m£}  p(z|m^) 

k=  1 


(40) 


Cancelling  the  common  term  and  changing  signs  yields  the 
following  definition  of  decision  region  Zr. 

P{rrij}  p(z]nij)  >  Pfm^}  p(z|mJl)  (41) 

for  all  If j . 

Equation  (41)  says  that  we  should  compute 

p{m,  }  p(z|m.)  for  k  =  1,  2,  ....  K  and  then  select  the 

decision  corresponding  to  the  value  of  k  for  which 

P{m,  }  p(z|m,  )  is  maximum.  In  other  words,  z  is  an  element 
K  K 

of  Z,  if 

J 

30 


i 


(42) 


P{m.)  p(z|m.)  =  max  P{m,  }  p(z|m,  ) 


Equation  (42)  thus  becomes  the  general  decision  rule  for  the 
probability  of  error  of  multiple  signals.  By  assuming  that 

:  ■ :  ■  •  i  ;  !:•  addition  o'  v. !:  i  t  <  a ir  :  :  a  a 

muo  ,  this  result  can  be  applied  to  t  lie  project  under  consid¬ 
er  a  t  i  c  >  n  . 

For  an  additive-noise  problem,  the  observation  is 
just  the  sum  of  the  signal  vector  and  a  noise  vector 

z  =  sk  +  n  (43) 

Therefore,  the  conditional  probability  density  function  of 

z.  as  before,  is  the  density  of  n  shifted  to  be  centered 

at  s.  : 

— k 

p(z|mk)  =  pn(z  -  sk)  (44) 

Now,  if  the  noise  is  white  and  gaussian,  the  conditional 
density  can  be  written  as 

o  _  i  /  2  1 1  £  ~  — k  1 1 

p(z|m.  )  =  (2tto“)  exp - = - 

K  2o^  (45) 

If  the  squared  length  of  a  vector  x  is  written  as  ||  x  ||  , 

then 
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2 


(46) 


x  [|  =  Z  x  ‘ 

i=l  1 


and  similarly,  ||  z  -  |j  represents  the  distance  squared 
between  z  and  s ,  .  Substitution  of  Eq  (45)  into  Eq  (42) 

yields  the  following 


P{rru  } 


2  -1/2 

(2ro  )  '  exp  - 


z  -  s  . 
-J 


2o 


max  P{m,  } 
k  K 


(2t to2)  I>/2  exp  - 


II  g  - 

2o2 


(47) 


Initially,  we  consider  the  equally  likely  case,  hence 

P{m.)  =  P{m,  }  .  Cancelling  common  terms  reduces  Eq  (47)  to 

J  K 


-ii  s  -  si  r 

exp  - r— - -  =  max  exp 

2cr  k 


£  "  ^k 


2o 


(48) 


If  we  take  the  logs  and  cancel  common  terms,  the  result  is 

-||  z  -  s.  ||2  =  max  -||  z  -  s,  ||2  (49) 

“  ~3  k  K 

Finally,  multiplying  both  sides  by  minus  1  causes  the  maxi¬ 
mum  to  become  a  minimum  and  Eq  (49)  is  now 


z  -  s  || 2  =  min  ||  z  -  s,  ||2 
-  -J  k  K 


(50) 
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Picturing  the  messages  as  points  in  an  1-dimensional  space, 


the  region  Z.  is  seen  to  be  the  set  of  all  points  that  are 

J 

closer  to  Sj  than  to  any  other  signal  point. 

Consider  a  two-dimensional  signal  space  with  two 
equally  likely  signal  points.  From  the  above,  wo  can  visu- 

.  th  i  pa  •  •  i u  i  \  '.  J*  ■  i  in  hul  1  ,  i  .  <  .  .  i  ; !  • 

points  closer  to  the  first  point  in  one  half  plane,  and  the 
remaining  points  which  are  closer  to  the  second  point  in 
the  other  half  plane.  The  dividing  line  or  boundary  is  seen 

to  be  the  perpendicular  bisector  of  the  line  connecting  the 
two  signal  points.  In  fact,  for  any  two-dimensional  signal 
space,  all  the  decision  regions  will  be  bounded  by  such 
segments.  It  is  interesting  to  note  that  the  boundary  will 
only  be  a  bisector  when  the  signals  are  equally  likely. 

When  the  signals  are  not  equally  likely,  the  boundary  will 
still  be  perpendicular,  but  will  be  shifted  toward  the  sig¬ 
nal  with  lesser  probability.  Another  point  to  note  is  that 
the  location  of  the  boundary  (hence,  the  decision  rule)  has 
been  completely  specified  without  using  the  variance  of  the 
noise.  This  is  so  only  because  the  signals  are  equiprobable. 
Although  finding  the  decision  regions  for  equiprobable  sig¬ 
nals  is  straightforward,  determining  the  probability  of 
error  can  be  more  complex. 


Probability  of  Error  for  Multiple  Decisions 


The  probability  of  error  given  message  mk ,  associ¬ 
ated  with  a  given  decision,  can  be  expressed  as  1  minus  the 
probability  of  a  correct  decision.  That  is  : 

Pfejm,  )  =  3  -  P{ Correct  Decision: 

=  1  -  p(dk|mk)  P I  nij. }  (51) 

Substitution  of  Eq  (9)  into  Eq  (51)  gives  the  probability 
of  error  given  as, 

P{e|mk}  =  1  -  /  p(z|mk)  dz  •  P{mk)  (52) 

Zk 

The  simplicity  of  this  equation  is  deceiving  because 
in  general  it  requires  the  computation  of  an  I-fold  integral 
It  would  be  foolhardy  to  attempt  to  calculate  this  with  pen¬ 
cil  and  paper  for  all  but  the  most  trivial  of  problems. 
However,  as  will  be  seen,  the  developed  program  uses  this 
equation  to  provide  an  approximation  of  the  conditional 
probability  of  error.  When  the  message  is  mk>  an  error  will 
occur  if  z  is  not  in  Zk-  Thus 

p ( e | mk }  =  P { z  i  zk ! mk >  (53) 

It  is  the  direct  calculation  of  Eq  (53)  which  provides  the 
aforementioned  complexity.  In  general,  the  error  event 
(P{z  i  becomes  a  function  of  inseparable  joint 

densities  which  cannot  be  simplified  or  easily  computed. 
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Hence,  it  is  not  always  possible  to  obtain  meaningful 
exact  expressions  for  error  probabilities. 

Concept  of  the  Union  Bound 

A  more  useful  approach  is  to  find  an  upper  bound  of 
the  probubiliiy  >>i  error  ihat  is  simple  and  that  is  also  a 
good  approximation.  Y.'e  desire  an  upper  bound  rather  than 
simply  a  good  approximation  because  systems  are  generally 
designed  to  meet  some  minimum  performance  standard.  The 
designer  must  be  certain  that  a  probability  of  error,  for 
example,  is  no  larger  than  some  given  number.  If  it  can  be 
guaranteed  that  an  upper  bound  on  the  error  probability  is 
lower  than  this  number,  then  the  designer  knows  the  require¬ 
ment  has  been  met.  Using  an  approximation,  the  designer 
could  never  be  sure. 

Consider  the  probability  of  the  union  of  two  events 
A  and  B  as  given  by 

P(AljB)  =  P(A)  +  P(B)  -  P(aOb)  (54) 

Assume  P(A)  and  P(B)  are  known,  but  not  P(A(|B).  Since 
P(aOb)  must  always  be  greater  than  zero,  if  it  is  deleted 
from  Eq  (54),  the  approximated  value  of  P(A^jB)  will  always 
be  greater  than  the  exact  value  of  P(A^_jB).  This,  then,  is 
the  concept  of  the  upper  bound.  The  amount  the  approxima¬ 
tion  of  P(A(J  B)  exceeds  the  exact  value  is,  of  course,  the 
value  of  P(Af~^B). 
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This  approach  can  be  generalized  quite  easily.  It 
is  called  the  "Union  Bound"  and  is  stated  in  the  following 
theorem  (Ref  3:115): 

If  the  event  A  is  the  union  of  K  events 

Lk 

A  is  bounded  by 

P(Ek)  (55) 

Using  Eq  (50),  we  can  write  the  decision  region 
as 

Zk  =  {z  :  ||  z  -  sk  ||2  <  ||  z  -  s£  ||2}  (56) 

for  all  which  can  be  written 

Zk  =  O  (z  :  ||  z  -  sk  ||2  <  ||  z  -  sA  ||2}  (57) 

SLfk 

Q 

Additionally,  its  compliment,  Zk,  can  be  expressed 

Zk  -  0  (z  :  I!  z  -  sk  ||2  >  ||  z  -  ||2}  (58) 

Using  this,  the  conditional  probability  of  error  is 


A  =  0 

k  =  l 


then  the  probability  of 


K 

P( A)  <i  Z 
k=l 
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P{e|mk)  =  Pr{z  c  Zk|mk} 


(59) 


By  substitution  of  Eq  (58)  into  Eq  (59),  we  get  Eq  (60): 

K 


P{e|mk)  =  Pr 


z  c  |J  {z  :  ||  z  -  s 
S  =  1  K 


7.  ~  S.  I|“) 


!  in, 


(60) 


Applying  the  concept  of  the  Union  Bound,  this  becomes 


K  2  9 

P{e|mk}  <  I  Pr  (z  :  ||  z  -  sR  \\*  >  ||  z  -  s£  1 1 2 1  n»k  >  (61) 

«,^k 

Each  term  in  the  summation  can  be  simplified  further.  When 
the  message  is  i^,  z  =  sfc  +  n  .  Thus,  the  expression  for 
each  l  becomes 


Pr{  ||  z  -  sk  ||2  >  ||  z  -  s£  1 1 2  I  mk  > 

=  Pr{  ||  n  +  sk  -  sfc  || 2  >  ||  n  +  sfc  -  s£  || 2  }  (62) 

which  can  be  reduced  to  yield 

Pr<ll  z  -  sk  II2  >  II  z  -  sz  ||2|mk} 

=  Pr{2nT(s£  -  sk)  >  ||  s£  -  sk  ||2}  (63) 

T 

As  shown  in  Appendix  A,  the  terra  2n  (s^  -  sk)  ,  is  a  zero 

2  2 

mean  gaussian  random  variable  with  variance  4a  ||s^-sk|| 
Using  this  fact  provides  the  following  simplified  expression 
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for  the  probability. 


That  is, 


Pr{  II  z  -  sk  II 2  >  II  z  -  s£  II2  |mk}  =  Q 


_£k 

2o 


(64) 


where  dpk  is  the  distance  between  any  two  message  vectors 


Hence,  the  conditional  probability  of  error  can  be  bounded 
by 


K 

P{e |nr  }  <  I 
K  £=1 
SLfk 


Q 


SLk 

2a 


(66) 


To  determine  the  overall  average  probability  of  error, 

Eq  (66)  is  averaged  over  all  K  so  that  the  Union  Bound  for 
the  system  becomes 


P 


e 


< 


K 

Z 

£=1 


(67) 


From  Eqs  (66)  and  (67),  we  see  that  the  Union  Bound,  an 
approximation  to  the  probability  of  error,  requires  only 
that  the  distances,  d^k,  between  the  signals,  and  a,  the 
system  noise  energy  be  known.  The  accuracy  of  this  approxi¬ 
mation  may  be  subject  to  question,  but  as  a  design  tool,  it 
is  certainly  much  easier  to  compute  and  implement  than 
Eqs  (52)  or  (53). 
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However,  we  have  only  considered  the  equally  likely 

case.  The  extension  to  the  general  case  is  not  difficult 

and  the  development  quite  similar.  The  general  decision 

rule  given  by  Eq  (42)  says  to  select  the  message  for  which 

P;m.l  p(zjm^)  is  a  maximum.  If  we  do  not  assume  that  the 

;  i  -.  .  i!c  :  1  not  cancel  and  .  !  :  :  i. 

the  final  definition  of  the  decision  region  7... 

.1 

If  P{m.}  p(z]m.)  is  to  be  the  maximum  of  a  set, 

J  d 

clearly  it  must  be  larger  than  every  other  element  in  the 
set.  Therefore,  the  set  of  z  for  which  P{m.)  p(z|m.)  is 
a  maximum  can  be  written  as  the  joint  intersection  of  those 
regions  of  Z  for  which  it  is  larger  than  Plm^}  p(z|ni^) 
for  each  If j .  In  other  woids, 

K 

Z.  =  Pi  {z  :  P{m . }  p(z | m . )  >  P{mp}  p(z|m  )} 

J  J  J  ^  ^ 

(68) 

If  we  use  Z . .  to  denote  the  £th  term  on  the  right  of  Eq  (68), 
J  *■ 

we  find  that  for  the  gaussian  case 


P(m.)  exp 

J 


2 


>  PCm^}  exp 


(69) 
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Taking  logs  and  cancelling  common  terms  simplifies  the 

expression  and  it  becomes 


Zj£  =  i  z  :  II  z  -  s  .  ||2  <  II  z  -  s#_  IT 


P  f  m  .  ] 


1  n 


!  70  > 


1!  Pm  !  and  P '  m  .  •  ;\r>-  euual,  the  Z.,  is  just  the  set  of 
.!  •  J  ■ 

points  that  are  closer  to  s  .  than  to  s? .  If  P { m  c }  is 

smaller  than  P{mj},  some  of  the  points  that  are  closer  to 

s^  will  be  included  in  Z^. 

We  know  that  for  equal  probabilities  the  boundary 

of  Z . „  is  the  perpendicular  bisector  of  the  line  that  joins 

jx. 

sff  and  s..  As  mentioned  previously,  even  if  the  probabili- 
ties  are  not  equal,  the  boundary  is  still  perpendicular  to 
(s0  -  s.)  .  To  show  this,  Eq  (70)  is  rewritten  by  writing 

out  the  squared  vector  lengths  and  collecting  similar  terms: 


z  :  2zrsl  -  2zTs j  <  ||  s^  ||2 
-  II  Sj  II2  ♦  2o2  in 


(71) 


Hence,  the  boundary  of  the  region  is  the  set  of  z  for  which 


zT(s£  -  S.)  =  |||  s£  II2  -  ||(  Sj  II' 


2  P{mj} 

0  ln  rejr 


(72) 
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The  set  of  z  for  which  z  (s  -  s.)  is  a  constant  is  a  line 
—  -  — t  — j 

that  is  perpendicular  to  (s.  -  s.) 

~  J 

As  for  the  equiprobable  case,  the  probability  of 
error  typically  is  not  easy  to  calculate.  However,  the 
union  bound  can  lv  used  on  Z.c  .  and  the  error  probability 

1  V'  1 


k  i  k  r 

P  i  7  ±  Pr  < 

c  j-l  K  ;-l  1 

j 


n  x  s  .  -  s , 


9  P(m.} 

+  2o^  In 

Ptm^} 


Using  the  same  logic  as  in  the  equiprobable  case,  this 


becomes 


K  K  d 

Pe  <  Z  P(m.)  S  Q 
j  =  l  J  £=1 


a  /Hm.} 

d^T  ln  (ptsJt 


For  a  particular  message  m^,  the  conditional  probability  of 
error  can  thus  be  expressed  as 


P{e|mk>  <  ^  Q 


Pim^} 

P{mk} 


As  noted  previously,  it  is  not  possible  to  fully 

2  2 

specify  the  decision  regions  without  knowing  a  .  If  a  is 
large,  the  decision  will  be  highly  biased  in  favor  of  the 


more  probable  messages.  This  is  reasonable  since  for  large 


'J 

the  received  signal  is  not  very  reliable.  On  the  other 
2 

hand,  if  o  is  small,  the  a  priori  probabilities  do  not 
affect  the  decision  regions  very  much.  Equation  (75)  is 
the  relationship  used  to  compute  the  Union  Bound  on  the 
probability  of  error  in  the  developed  program. 
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Ill . 


Concept  and  Design  of  Soi tware 


Introduction 

As  a  tutorial  tool,  the  main  objective  of  Program 
SIGDET  is  to  acquaint  the  user  with  certain  aspects  of  com- 
■  tii  ;• :  :  :  c  I ;  ■;  and  with  how  t  hr  -  <  ■  <  .• »  io:.  ! 

the  signal  set  affects  the  operation  of  the  communication 
system.  By  relieving  the-  user  of  hours  of  tedious  numerical 
calculations,  SIGDET  allows  him  to  alter  signal  location 
(energy),  proximity,  probability,  and  system  noise  to  quickly 
gain  an  appreciation  of  the  interaction  and  relationships  of 
each  of  these  factors. 

The  program  consists  of  23  subroutines  in  all;  ten 
are  designed  to  allow  the  user  to  input  and  manipulate  data, 
nine  are  strictly  computational,  three  are  dedicated  to  out- 
putting  or  displaying  data,  and  one  subroutine,  though  pri¬ 
marily  computational,  also  provides  output. 

In  general,  once  the  signal  set  has  been  specified, 
practically  all  required  computations  are  carried  out  using 
default  values  for  all  other  parameters.  This  is  done  prior 
to  the  option  prompt  being  provided  to  the  user.  Hence,  all 
options  are  available  at  all  times.  Should  the  signal  set 
be  changed  (translated,  having  a  point  added  or  deleted, 
etc.)  or  should  a  previously  defaulted  variable  parameter  be 
user  specified  (system  noise  energy),  all  required  computa¬ 
tions  are  again  performed  before  the  option  prompt  is  provided. 
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Aft  it  an  explanation  of  the  main  program  operation, 
each  subroutine  will  be  discussed  and,  where  necessary,  the 
algorithms  used  will  be  explained.  The  data  input  routines 
will  be  presented  first,  followed  by  the  computational  rou¬ 
tines.  and  finally  the  routines  which  display  the  answers. 

•  •  •  •  ’  (  I  | 

the  matrix  which  stores  the  coordinates  of  the  bisector 
intersections  is  helpful  for  following  the  construction  and 
execution  of  the  program.  An  explanation  of  this  matrix  is 
therefore  included  at  the  end  of  the  chapter. 

Main  Program  Operation 

With  the  signal  set  entered  and  the  values  of  system 
noise,  scaling  factor,  and  signal  probabilities  assigned  by 
default,  the  computation  below  occurs: 

1.  Using  only  the  number  and  coordinates  of  the 
signal  points,  the  energy  in  each  signal  is  determined. 

2.  Using  the  data  above  and  the  system  noise  energy 
(default  value  gives  a  noise  variance  or  PSD  =  1.0),  the 
signal-to-noise  ratio  of  each  signal  is  determined. 

3.  Using  the  signal  coordinates  and  the  signal 
probabilities  (default  values  are  equally  likely),  the  sys¬ 
tem  center  of  gravity  is  computed. 

4.  Now  the  computational  heart  of  SIGDET  is  per¬ 
formed.  The  minimum  and  maximum  X-Y  dimensions  of  the  sig¬ 
nal  set  are  determined.  If  the  X-Y  axis  is  not  within  these 
limits,  adjustments  in  the  required  directions  are  made  to 
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accommodate  both  axes.  Then  the  equation  of  an  imaginary 
circle  which  circumscribes  the  entire  signal  set  is  deter¬ 
mined  using  these  dimensions.  Next,  the  signals  are  con¬ 
sidered  two  at  a  time,  the  distance  between  each  set  of  two 
points  is  computed  and  the  midpoint  of  the  line  drawn 

Tie  r  (!•  :  /:  .  !  i  s  midpoint  t  );•  point  - 

slope  form  of  the  equation  of  a  straight  line,  an  equation 
lor  the  perpendicular  bisector  between  each  two-point  set  is 
determined.  Simultaneous  solution  of  this  equation  and  the 
equation  of  the  circle  yields  the  two  points  of  intersection 
of  each  perpendicular  bisector  and  the  circle,  that  is,  the 
endpoints  of  each  bisector.  These  coordinate  pairs  are 
stored  in  a  large  matrix  and  become  the  basis  for  all  future 
computation.  Using  the  two-point  form  of  the  equation  of  a 
straight  line,  the  points  of  intersection  of  all  the  perpen¬ 
dicular  bisectors  are  determined.  Another  subroutine  deter¬ 
mines  which  of  these  points  of  intersection  are  the  end¬ 
points  of  the  line  segments  which  make  up  the  decision 
boundary  regions. 

5.  Finally,  using  the  computed  signal  separation, 
the  system  noise  energy,  and  the  probabilities  of  each  sig¬ 
nal,  an  upper  bound  on  the  probability  of  error  for  each 
signal  is  determined  and  the  program  is  ready  to  prompt  for 
user  options. 
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Data  Input  Subroutines 


The  table  below  lists  each  data  input  subroutine  and 
its  particular  function. 


TABLE  I 

DATA  1  Nl’TT  Si  !.l:Oi"i  i\T.S 


UU  t  III!'  .xUI.ii' 

i  l.iD  {  i  »  )  i  1 

CURSOR 

Input  signal  points  using  cursor 

DIRECT 

Input  signal  points  by  specifying 
coordinate  pairs 

TRANS 

Input  amount  of  movement  in  X-Y 
directions  signal  set  is  to  be  moved 

ROTATE 

Input  angle  of  rotation 

ADDGRA 

Add  signal  point  using  cursor 

ADDDIR 

Add  signal  point  by  specifying  coor¬ 
dinates  of  the  point 

DELETE 

Remove  unwanted  signal  point 

SNOISE 

Specify  system  noise  energy 

SGPROB 

Specify  probability  of  each  signal 

SCALER 

Input  scaling  factor  to  expand  field 
of  display 

Subroutine  CURSOR.  The  function  of  this  subroutine 
is  to  allow  the  user  to  input  the  signal  set  coordinates  by 
utilization  of  a  graphical  cursor.  A  square  region  is  drawn 
on  the  screen,  the  X-Y  axis  displayed,  and  the  cursor  (repre¬ 
sented  by  crosshairs)  provided  which  is  to  be  manipulated  by 
user.  In  order  for  the  graphics  package  to  be  able  to  assign 
x  and  y  values  to  any  location  of  the  cursor,  some  frame  of 
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reference  or  scale  must  be  established  so  that  the  cursor 
"knows  where  it  is."  For  this  reason,  the  user  is  required 
to  provide  the  X  and  Y  dimensions  of  the  signal  set  he  wishes 
to  study.  These  dimensions  thus  describe  the  "window"  inside 
which  the  entire  signal  set  will  reside.  The  user  positions 
;  .  -sec  t  :  -  >r.  <>'  '  :  "s  .  ea  !  1  •  d  the  •  ’••ini. 

at  the  location  he  desires  to  place  a  signal  point.  By 
entering  the  letter  "P"  via  the  terminal  keyboard,  the  user 
identifies  the  cursor  location  as  a  signal  point  and  the 
coordinates  of  this  location  are  computed  and  stored  in 
matrix  "PTS."  An  asterisk  is  displayed  at  the  location  of 
the  point  and  the  number  of  the  signal  is  displayed  to  the 
right  of  the  asterisk.  The  cursor  is  then  free  to  be  moved 
to  the  next  signal  location.  A  count  is  maintained  of  the 
number  of  signals  so  entered  and  when  the  entire  signal  set 
has  been  input,  the  cursor  is  moved  to  a  position  just  below 
the  window  and  a  listing  of  the  signal  set  coordinates  is 
displayed.  Since  there  is  limited  space  beneath  the  window, 
only  the  first  four  points  are  listed  and  the  user  is  given 
the  choice  of  having  the  screen  cleared  and  the  remaining 
points  listed,  or  simply  continuing  with  the  program.  In 
either  case,  the  prompt  causes  a  pause  in  program  execution 
to  allow  the  user  to  copy  screen  display  if  desired  prior  to 
continuing.  After  the  decision  has  been  made  and  executed, 
control  of  the  program  returns  to  mainline. 
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Subroutine  DIRECT.  The  function  of  this  subroutine 
is  to  allow  the  user  to  input  the  signal  set  points  simply 
by  specifying  the  actual  coordinate  pair  of  each  signal 
point.  This  enables  accurate  placement  of  signals,  particu¬ 
larly  for  symmetric  signal  sets  and  the  use  of  a  terminal 
■  .  :  :  ea  I  -  :  .  '  !  i  • . 

the  routine  provides  a  prompt  for  the  user  to  input  the 
coordinates  of  each  signal.  The  standard  FORTRAN  READ  rou¬ 
tine  is  used  to  receive  input  from  the  user,  i.e.,  the  user 
needs  only  to  enter  the  coordinates  in  normal  decimal  nota¬ 
tion.  The  values  are  separated  by  a  comma  and  a  carriage 
return  signals  completion  of  a  line  of  input.  After  all 
coordinate  pairs  have  been  entered,  the  program  execution 
begins . 

Subroutine  TRANS.  This  subroutine  provides  the 
capability  of  translating  the  signal  set.  The  user  is  given 
a  prompt  requesting  the  amount  of  movement  in  the  X  and  Y 
directions.  In  order  to  translate  the  signal  set,  the 
amount  of  movement  in  the  X  direction,  DELTAX,  is  added  to 
the  x-coordinate  of  each  signal  point.  Similarly,  DELTAY  is 
added  to  the  y-coordinate  of  each  signal  point.  In  this  way 
the  original  frame  of  reference,  that  is,  the  original  X-Y 
axis  remains  fixed  and  each  signal  (hence  the  entire  signal 
set),  is  translated  in  relation  to  it.  After  all  the  signal 
point  coordinates  have  been  appropriately  adjusted,  control 
returns  to  mainline. 


Subroutine  ROTATE.  Subroutine  ROTATE  allows  the 


signal  set  to  be  rotated  about  the  X-Y  axis.  The  routine 
begins  by  asking  the  user  to  provide  the  angle  of  rotation, 
positive  or  negative  between  0  and  360  degrees.  This  angle 
in  degrees  is  immediately  converted  to  radians  and  a  check 
I  as  :i  >t  v-  t  .  :  •  ! 

radians.  If  so,  an  error  message  is  displayed  and  a  prompt 
for  the  angle  is  again  provided.  In  order  to  perform  the 
rotation,  the  values  ol  all  signal  point  coordinate  pairs 
are  changed  to  represent  their  ncu )  value  in  the  rotated  sys¬ 
tem.  The  fundamental  formulae  for  rotation  of  an  X-Y  axis 
through  an  angle  6  are  given  by: 

x  =  x'cosQ  -  y'sin9 

y  =  x'sinQ  +  y’cose  (76) 

where  x’  and  y1  are  the  coordinates  of  point  (x,y)  in  the 
rotated  X-Y  axis.  Rewriting  these  equations  in  terms  of  x’ 
and  y'  yields: 

x'  =  ycos0  -  xsinB 

y'  =  xcos0  +  ysin0  (77) 

These  then  are  the  equations  used  to  determine  the  new  values 
of  the  signal  point  coordinates  in  relation  to  an  X-Y  axis 
whiah  has  been  rotated  an  amount  equal  to  theta.  However, 
in  order  to  represent  the  values  when  the  signal  set  is 
rotated  instead,  the  sign  of  the  user  inputted  angle  is 
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changed  prior  to  computation.  Furthermore,  the  two  equa¬ 
tions  interact,  i.e.,  once  a  new  value  of  the  signal's 
x-coordinate  is  computed,  that  value  cannot  be  used  to  com¬ 
pute  the  new  y-coordinate .  The  old  x-coordinate  value  must 
still  be  available.  Hence,  prior  to  any  computation,  the 

.....  .  !  ...  1  1’i  i  .  i'  .  '  '  .  \  ' 

named  "SAVPTS"  so  that  the  original  signal  set  is  continu¬ 
ously  available  when  computing;  the  new  signal  set  values. 

When  all  points  have  been  thus  rotated,  control  returns  to 
mainline . 

Subroutine  ADDGRA.  Should  the  user  desire  to  add  a 
signal,  he  has  two  methods  available.  This  particular  rou¬ 
tine  allows  the  additional  signal  to  be  added  graphically. 

To  accomplish  this,  the  user  is  first  provided  a  display  of 
the  current  signal  set.  The  display  is  presented  via  a  call 
to  subroutine  PLOT  (see  Section  III,  Output  Subroutines). 
Subroutine  PLOT  displays  the  window,  the  X-Y  axis,  the  current 
signal  set,  and  a  prompt  providing  the  user  the  choice  of 
having  the  screen  cleared  and  the  coordinates  of  the  signals 
listed  or  continuing  with  program  execution  leaving  screen 
display  intact.  The  second  choice  is  mandatory,  whereupon 
the  cursor  crosshairs  will  be  displayed.  The  user  positions 
the  crosspoint  as  desired  and  enters  a  "P"  via  the  terminal 
keyboard.  As  before,  an  asterisk  and  corresponding  signal 
number  are  displayed.  Finally,  the  cursor  is  moved  to  the 
lower  portion  of  the  screen  and  the  coordinates  of  the  added 


signal  are  listed  on  the  screen.  Since  the  user  may  wish  to 
copy  this  new  signal  set  as  displayed,  program  execution  is 
halted  and  a  prompt  for  user  to  enter  any  digit  to  continue 
is  provided.  After  a  digit  is  entered,  screen  is  cleared 
and  execution  returns  to  mainline. 

'  ;V,u j  ' ;  ...  ■  r«  if!)  with  >••!!}.:•  •at  i  );>• 

ADDGKA ,  this  subroutine  allows  the  user  to  add  additional 
signal  points  by  directly  specifying  the  coordinates  of  the 
new  signal.  It  is  very  similar  to  subroutine  DIRECT;  how¬ 
ever,  the  prompts  to  the  user  have  been  altered.  Here  the 
user  is  initially  prompted  for  the  x-coordinate  of  the  new 
signal  and  then  prompted  for  the  y-coordinate .  The  input 
format  is  the  same  as  in  DIRECT  and  after  both  coordinates 
are  entered,  program  control  returns  to  mainline. 

Subroutine  DELETE.  This  subroutine,  as  may  be 
expected,  allows  the  user  to  remove  an  unwanted  signal. 

Since  each  signal  is  numbered,  the  user  simply  provides  the 
number  of  the  unwanted  signal.  This  number,  given  the  vari¬ 
able  name  GONE,  is  used  as  an  index  variable  in  a  do  loop 
that  erases  the  coordinates  of  the  deleted  signal  and  succes¬ 
sively  "moves  up"  each  remaining  signal  in  the  signal  point 
matrix  PTS.  Hence  the  user  should  be  aware  that  all  points 
with  a  number  greater  than  the  one  deleted  will  be  renum¬ 
bered  . 

Subroutine  SNOISE.  This  subroutine  has  a  two-fold 
function.  It  informs  the  user  what  the  system  noise  energy 
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would  have  to  be  in  order  for  the  largest  signal-to-noise 
ratio  to  be  zero  decibels.  This  provides  the  user  a  starting 
point  for  selecting  variable  noise  energy  values.  Secondly, 
this  routine  allows  the  user  to  override  the  default  noise 

energy  of  2.0  (which  results  in  a  noise  variance  or  power 


By  utilization  of  the  intrinsic  function  MAX.  the  largest 
individual  signal  energy  is  determined.  Then  from  the  defi¬ 
nition  for  signal-to-noise  ratio  (SNR)  (Ref  10:250), 


rldb  * 10  ^loir 


(78) 


it  is  evident  that  when  N =  E  ,  the  signal-to-noise  ratio 

O  S 

will  be  zero  db.  Hence  the  user  is  informed  that  the  noise 
energy  level  must  be  equal  to  this  maximum  signal  energy  for 
the  condition  above  to  exist.  After  the  user  supplies  the 
desired  noise  energy,  a  check  is  made  to  assure  that  the 
entered  value  is  greater  than  zero.  If  not,  an  error  message 
is  displayed  and  prompt  provided  again.  The  routine  informs 
the  user  of  the  resulting  value  of  the  noise  variance  or 
power  spectral  density  prior  to  returning  to  mainline. 

Subroutine  SGPROB.  The  purpose  of  this  routine  is 
to  allow  the  user  to  specify  the  individual  signal  probabil¬ 
ities.  The  program  automatically  computes  all  signal  proba¬ 
bilities  for  the  equally  likely  case.  Upon  selecting  this 
option,  the  user  is  provided  with  a  prompt  and  enters  each 


signal  probability  one  at  a  time.  Standard  format  is  used, 
and  as  each  probability  is  read  it  is  checked  to  certify 
that  it  is  greater  than  zero.  If  not,  an  error  message  is 
provided  and  the  prompt  again  given.  After  all  probabilities 
have  been  entered,  a  check  is  made  of  their  sum.  Should  the 
:  ha  n  ;  :  ■  \ :  1  .  '5 .  a  r.  orr< 

is  displayed  and  all  probabilities  must  be  reentered.  After 
a  more  accurate  set  of  signal  probabilities  has  been  entered, 
the  program  returns  to  mainline. 

Subroutine  SCALER.  Subroutine  SCALER  enables  the 
user  to  alter  the  "size"  of  the  "window"  encompassing  the 
signal  set.  The  signals,  of  course,  maintain  their  relative 
positions,  but  the  scale  or  the  boundary  which  surrounds 
them  can  be  made  to  expand,  thus  in  effect  compressing  the 
display  of  the  signal  set.  This  is  useful  in  that  it  allows 
all  boundary  region  intersections  to  be  displayed;  in  fact, 
it  is  used  by  subroutine  EXACT  to  do  just  that.  The  window 
can  also  be  reduced,  but  the  author  cannot  envision  a  situ¬ 
ation  in  which  a  window  smaller  than  the  original  would  be 
needed.  Subroutine  WINDOW  is  structured  such  that  it  deter¬ 
mines  the  minimum  and  maximum  X  and  Y  dimensions  so  that  the 
entire  signal  set  is  enclosed,  the  X-Y  axis  is  included 
within  the  window,  and  the  window  is  a  square.  The  window 
is  made  a  square  to  ensure  that  the  scales  along  the  X  and  Y 
axis  are  identical  (see  subroutine  WINDOW).  Once  the  values 
of  XHIN,  XMAX,  YMIN,  and  YMAX  have  been  determined,  the 
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center  of  the  square  is  computed  and  then  these  lour  values 
are  recomputed  with  the  scaling  factor  as  a  multiplier.  The 
default  value  is  one;  a  value  greater  than  one  expands  the 
window,  whereas  a  value  less  than  one  would  shrink  the  win¬ 
dow.  In  conclusion,  the  actual  physical  dimension  of  the 

! '  ' 

alone  the  axes  have  been  altered. 

Tin  Computational  Subroutines 

Once  the  required  data  has  been  provided,  the  program 
is  ready  to  perform  the  basic  calculations.  Table  II  lists 
each  computational  subroutine  used  along  with  a  description 
of  its  function. 

Subroutine  SGENGY .  The  function  of  this  routine  is 
to  compute  the  individual  energy  of  each  signal  and  then 
store  the  results  in  array  "ENGY" .  Given  the  x  and  y- 
coordinates  of  a  signal  point  on  a  two  dimensional  plane,  it 
computes  the  energy  as  the  "length"  or  norm  of  the  vector 
from  the  origin  to  the  signal  point.  Hence  the  energy  is 
the  sum  of  the  square  of  the  X  and  Y  distances.  Mathemati¬ 
cally  this  becomes: 

2  2 

Energy  =  (x-coordinate)  +  (y-coordinate)  (79) 

After  each  signal  energy  is  computed  and  stored,  control 
returns  to  the  main  program. 

Subroutine  SNRCOM.  Subroutine  SNRCOM  uses  the  system 
noise  energy  level  and  the  computed  individual  signal 
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TABLE  II 


Subroutine 

s  g  r:\nv 

GRACEX 

WINDOW 

BISECT 

POINTS 

REGION 

PERROR 

EXACT 

CMPUTE 


COMPUTATIONAL  SUBROUTINES 

Name  Function 

Co:  . rut  e  t-ncrvy  of  individual  signals 

i.  :  .  . .  t  ’-in  i '  ru  t  i  <  >  o  i 

encli  signal 

Compute  center  oi  gravity  of  signal 
so  l 


Determines  minimum  and  maximum  X  and 
V  dimensions  of  signal  set  and 
equation  of  circumscribing  circle 

Determines  coordinates  of  endpoints 
of  all  perpendicular  bisectors 

Determines  coordinates  of  all  points 
of  intersection  of  all  perpendicular 
bisectors 

Determines  which  points  above  are 
the  endpoints  of  the  decision  region 
line  segments 

Uses  the  concept  of  the  Union  Bound 
to  compute  an  upper  limit  to  the 
probability  of  error  for  each  signal 

Computes  the  probability  of  error  for 
each  signal  by  integrating  the  den¬ 
sity  function  providing  a  tighter 
bound 

Forms  the  basis  for  computation  and 
display  of  the  decision  regions. 

Calls  WINDOW,  BISECT,  POINTS,  and 
REGION 
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energies  to  determine  the  signal-to-noise  ratio  (SNR)  for 
each  signal.  The  computation  is  based  on  the  definition  for 
the  signal-to-noise  ratio  used  in  subroutine  SNOISE: 
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10  log10  — 
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Since  th('  log  of  zero  is  undefined,  when  a  signal  is  at 
the  origin  or  has  zero  energy,  its  SNR  should  also  be  unde¬ 
fined.  In  this  routine,  however,  if  a  signal  has  zero 
energy,  its  SNR  is  automatically  set  equal  to  -999.9999  to 
indicate  this  situation.  Clearly,  if  a  signal  has  no  energy, 
there  is  in  fact  no  signal  and  the  receiver  sees  only  noise. 
After  all  the  SNR’s  have  been  computed  and  stored  in  array 
"SNR"  program  control  returns  to  mainline. 

Subroutine  GRACEN.  This  subroutine  computes  the 
physical  center  of  gravity  of  the  signal  set  based  on  the 
location  of  the  signals  and  their  probabilities.  When  the 
.signal  probabilities  are  equally  likely,  the  x-coordinate 
of  the  resulting  center  of  gravity  is  easily  seen  to  be  just 
the  average  of  the  sum  of  the  x-coordinates  of  all  the  sys¬ 
tem's  signals.  The  same  is  true  for  the  y-coordinate .  This 
is  not  the  case  when  the  signal  probabilities  are  no  longer 
,  identical.  Borrowing  a  little  theory  from  the  physics  of 
masses,  an  expression  for  the  moment  of  inertia  or  mean 
energy  around  the  origin  of  a  system  of  N  point  masses  is 
given  by  (Ref  10:  247): 
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where  the  mass  of  the  i**1  point  is  P{nn}  and  its  position 
is  s . .  For  a  given  set  of  point  masses  (signal  probabili- 
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i=l  (81) 

is  a  minimum.  Since  the  moment  of  inertia  (mean  energy)  is 
a  minimum  when  taken  around  the  centroid  (center  of  gravity), 
it  follows  that  a  should  be  chosen  so  that  the  resulting 
centroid  coincides  with  the  origin.  Thus,  a  or  the  center 
of  gravity  can  be  found  from  the  relation: 

N 

a  =  l  P{ra . }s . 

i=l  (82) 

Hence,  in  order  to  determine  the  x-coordinate  of  the  system 
center  of  gravity,  this  routine  sums  the  product  of  each 
signal's  probability  and  its  x-coordinate.  Similarly,  the 
y-coordinate  is  found.  After  all  the  signals  have  been  con¬ 
sidered,  the  center  of  gravity  has  been  determined  and  con¬ 
trol  of  the  program  returns  to  mainline. 

Subroutine  WINDOW.  The  purpose  of  subroutine  WINDOW 
is  to  determine  the  X  and  Y  dimensions  of  the  graphical 
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window  such  that  the  entire  signal  set  is  enclosed  and  the 
X-Y  axis  is  within  the  confines  of  its  boundaries.  Addi¬ 
tionally,  this  routine  determines  the  center  of  the  window 
and  from  this  computes  the  radius  of  a  circle  circumscribing 
the  square  window.  In  order  to  determine  the  window  dimen- 
i  oil-. ,  : !.  •.  i  maximum  x  a:  ’  i  ir  t •  •  1  •  >  •  >  f 

t  h<*  inline  sign  a  I  set  are  found.  The  range  of  each  dimen- 
i  •  a  i .  i  .1.  Then  a  check  is  to  see  if  the  Y-axis 

is  w  i  Lai.,  lie.  X-u  i  a.en.e  nan  range .  Basically  .  if  the  maximum 
x-coordinate  value  is  greater  than  zero  and  if  the  minimum 
x-coordinate  value  is  less  than  zero,  then  the  Y-axis  is 
within  the  X-dimension  range.  If  this  is  not  the  case,  then 
an  adjustment  to  the  appropriate  X-dimension  is  made.  For 
instance,  if  all  the  signal  points  have  x-coordinate  values 
greater  than  zero,  then  the  minimum  X-dimension  will  be 
adjusted  so  that  it  is  negative  and  the  X-range  will  thus 
include  the  Y-axis.  The  amount  that  the  X-dimension  is  made 
negative,  i.e.,  the  value  of  the  adjusted  XMIN,  is  one-tenth 
of  the  initial  value  of  X-range.  A  similar  check  and  adjust¬ 
ment  is  made  for  the  y-coordinate  values.  The  signals  them¬ 
selves  always  remain  unchanged,  however.  Next,  the  window 
is  squared  so  that  the  scales  along  each  axis  will  be  iden¬ 
tical.  In  order  to  accomplish  this,  the  difference  in  length 
of  the  two  ranges  is  determined.  The  minimum  value  of  the 
shorter  range  has  one-half  this  difference  subtracted  from 
it,  whereas  the  maximum  value  of  the  shorter  range  has 
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one-half  the  difference  added  to  it.  Hence  the  shorter 
range  is  lengthened  on  each  end  so  that  it  now  equals  the 
longer  range.  With  the  window  geometrically  as  well  as 
physically  square,  the  new  range  of  each  dimension  is  deter¬ 
mined  and  the  center  of  the  window  reverified.  At  tills 

an  ’  '  ion  •  ad.pn 

according  to  the  scaling  factor.  With  the  window  still 
square,  the  adjusted  X  and  V  ranges  are  recomputed.  Finally 
the  radius  of  the  circumscribing  circle  is  determined  as  the 
length  from  the  center  of  the  window  to  one  of  the  corners. 

To  preclude  roundoff  error,  a  fudge  factor  of  one-half 
X-range  is  added  to  the  radial  length.  Thus,  the  window 
scale  can  be  adjusted  by  the  user,  but  it  always  remains  a 
square  and  its  physical  size  as  displayed  on  the  screen  will 
always  be  the  same. 

Subroutine  BISECT.  This  subroutine  determines  the 
coordinates  of  the  endpoints  of  the  perpendicular  bisectors 
between  all  combinations  of  any  two  signal  points.  As  men¬ 
tioned  in  the  matrix  "IN"  discussion,  the  perpendicular 
boundary  line  between  any  two  signal  points  will  be  a 
bisector  only  when  the  probabilities  of  the  two  points  are 
equal;  otherwise,  the  boundary  will  shift  toward  the  signal 
with  the  smaller  probability.  Although  this  subroutine  is 
designed  to  work  with  any  combination  of  legal  probabilities 
which  sum  to  unity,  the  term  bisector  will  be  used  regardless 
of  the  actual  location  of  the  perpendicular  boundary. 


59 


This  subroutine  is  called  by  subroutine  CMPUTE, 
hence  it  is  called  once  for  every  signal  point.  The  points 
are  indexed  successively  and  BISECT  takes  the  point  selected 
by  subroutine  CMPUTE  (hereafter  to  be  called  the  lead  point) 
and  considers  it  with  every  other  signal  point.  First  the 
i  b<  tween  tin  tv.v  signal  points  under  consideration 

is  determined  and  stored  in  matrix  "DISTA".  Then  the  mid¬ 
point  of  the  line  connecting  the  two  signal  points  is  found. 
Using  the  point-slope  form  of  the  equation  of  a  straight 
line,  the  coordinates  of  the  midpoint,  and  the  slope  of  the 
connecting  line,  the  equation  of  each  bisector  is  known.  A 
check  is  made  to  see  if  the  bisector  is  horizontal,  for  if 
it  is,  then  the  endpoints  are  readily  available,  i.e.,  the 
x-coordinates  will  be  just  the  minimum  and  maximum  X- 
dimensions  of  the  window  and  the  y-coordinates  will  be  equal 
to  the  y-coordinate  value  of  the  midpoint.  Similarly,  a 
check  is  made  to  determine  if  the  bisector  is  vertical  with 
correspondingly  easily  obtained  endpoints.  Otherwise,  the 
endpoints  must  be  found  from  the  solution  to  a  set  of  simul¬ 
taneous  equations,  the  equation  of  the  bisector  and  that  of 
the  circumscribing  circle.  The  details  of  these  computa¬ 
tions  will  be  presented  below.  The  coordinates  of  the  points 
of  intersection  thus  become  the  coordinates  of  the  endpoints 
of  each  bisector  and  are  stored  in  matrix  IN.  These  coordi¬ 
nates  become  the  basis  for  all  remaining  computation  con¬ 
cerned  with  the  decision  region  boundaries. 
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Discussion  of  Bisector  Location.  As  mentioned  above, 


the  location  of  a  perpendicular  bisector  is  at  the  midpoint 
of  a  line  connecting  two  signal  points  only  when  the  two 
signals  are  equally  likely.  If  this  is  not  the  case,  the 
boundary  is  shifted  by  an  amount  ''DELTA",  found  from  the 

following,  equation  (Kef  10:231  )  : 


N 


o 


2d 


in 


P{mi} 

PTmTT 


(83) 


where  Nq  =  system  noise  energy 

d  =  distance  between  the  two  signals 

P{mk}  =  probability  of  signal  k 

and  where  the  sign  of  DELTA  is  determined  by  the 
P{m.) 

In  xr-7 - t-  .  That  is,  when  P{m.  }  >  P{m.}  ,  the  midpoint 

P(m.}  l  j 

J 

will  be  shifted  toward  m..  This  subroutine  uses  trigonomet- 

0 

ric  relationships  to  determine  the  adjusted  coordinates  of 
each  "midpoint"  using  the  value  of  DELTA  computed  for  each 
pair  of  signals  considered. 

For  example:  Given,  Point  1  (1,1)  with  Ptn^}  =  .8 

Point  2  (3,2)  with  Pinig}  =  .2 

a,  defined  as  the  angle  of  inclination  of  the 
connecting  line  (not  to  be  confused  with  the 
symbol  for  noise  energy) 

Figure  2  shows  the  bisector  for  the  equally  likely  case  and 

Figure  3  shows  how  the  bisector  is  shifted  due  to  the  change 

in  the  signal  probabilities. 
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The  new  midpoint  location  is  computed  as  follows: 

First  the  value  of  SIGMA  is  found  and  then  the  value  of 


DELTA  is  determined. 

Ay  1 

c  =  arctan  ^  =  arctan  ^  =  26.56° 

]'  ■ 

1  ! 


(Assuming  noise  energy,  Nq ,  is  taken  as  2.0) 

From  the  figures  and  basic  trigonometry,  the  new  coordinates 
become: 


xnew  =  xold  +  Acos a  =  2.  +  0.554  =  2.554 
ynew  =  yold  +  Asina  =  1.5  +  0.277  =  1.777 

In  such  a  fashion,  the  subroutine  shifts  the  "midpoint" 
depending  on  the  system  noise  and  the  signal  probabilities. 

Unfortunately,  determining  the  value  of  SIGMA  is  not 
as  straightforward  as  it  appears  on  the  surface.  The 
FORTRAN  intrinsic  function  ATAN  returns  a  value  between  -tj- 
and  ^  for  the  arctangent.  Hence,  if  in  the  figures  above, 
a  were  obtuse,  this  function  would  not  provide  the  positive 
angle  greater  than  but  its  negative  supplement.  There¬ 
fore,  after  a  is  determined,  two  situations  may  exist: 

(1)  its  value  is  returned  as  positive,  i.e.,  between  zero 
and  7j,  or  (2)  as  negative,  i.e.,  less  than  zero  but  greater 
than  -7j.  BISECT  checks  for  this  and  then  must  determine  in 
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which  order  the  coordinates  of  the  signal  points  happened 
to  be  used  to  compute  the  value  of  a.  The  two  cases  below 
demonstrate  this. 


Z  (1,2) 

v— 7— 


(3,1) 


-1 - • - 1 - 1 - 1 - » - 1 - 1 - r 

1  2  3  4  5 


Fig  4.  Computation  of  Angle  of  Inclination, 

Case  1 


Fig  5.  Computation  of  Angle  of  Inclination, 

Case  2 


Assume  the  lead  point  is  point  Z,  and  the  next  point  is  J. 
We  would  then  compute  SIGMA  from  the  following  equation: 


a 


arctan 


y.i  ~  yz 
*3  ~  XZ 
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(84) 


Hence,  in  Figure  4  we  have: 


1-2  1 

=  arctan  yry  =  arctan(-y) 

a1  =  -26.5° 

which  is  the  desir.d  angle.  In  Figure  5,  we  compute: 

2-1  1 

0O  =  arctan  -y-y  =  arctan(- 

o 2  =  -26.5° 

which  is  not  the  desired  angle,  but  its  supplement!  BISECT 
ge+  >  * -ound  this  by  checking  whether  the  y-coordinate  of  the 
lead  point  (Z)  is  less  than  that  of  the  second  point  (J). 
There  are  then  four  conditions  which  may  exist: 

1.  SIGMA  is  greater  than  or  equal  to  zero  and 

a.  Z's  y-coordinate  is  greater  than  J's  or 

b.  Z’s  y-coordinate  is  less  than  J's 

or  2.  SIGMA  is  less  than  zero  and 

a.  Z's  y-coordinate  is  greater  than  J's  or 

b.  Z's  y-coordinate  is  less  than  J’s 

BISECT  checks  to  determine  which  situation  exists  and  only 
then  computes  the  adjusted  location  of  the  "midpoint".  Four 
different  sets  of  two  equations  are  used  to  correctly  adjust 
the  x  and  y-coordinates .  In  the  example  above,  let  us 
assume  that  Figure  5  indicates  the  actual  locations  of  the 
lead  point  and  the  next  point  under  consideration.  Then, 
since  the  returned  value  of  SIGMA  is  less  than  zero  and  Z’s 


y-coordinate  is  less  than  J's  y-coordinate ,  the  equations 
would  become: 


xnew  =  xold  -  Acosa 
ynew  =  yold  -  Asina 


If  we  further  assume  r-;m  }  =  0.8  and  P-m.}  =  0.2  ,  then 

z  j 

DELTA  becomes : 


A 


In 


p{mzl 

P{m  } 
0 


— —  In  4 
2-/5 


0.6199 


and  hence: 

xnew  =  xold  -  0.6199  cos  (-26.5)  =  2  -  0.55  =  1.44 
ynew  =  yold  -  0.6199  sin  (-26.5)  =  1.5  +  0.276  =  1.77 

Therefore,  the  midpoint  at  (2,1.5)  has  been  moved  to 
(1.44,1.77)  or  closer  to  Point  J  as  desired. 

To  prevent  the  possibility  of  division  by  zero,  before 
the  value  of  SIGMA  is  computed,  a  check  is  made  which  deter¬ 
mines  if  the  absolute  difference  between  the  x-coordinates 

of  the  two  points  being  considered  is  less  than  COMPAR 
-9 

(10  ).  If  so,  the  value  of  SIGMA  is  set  equal  to 

1.5707963268  radians  (^),  and  the  execution  of  the  subroutine 
continues.  In  this  fashion,  the  location  of  each  midpoint 
is  adjusted  prior  to  the  determination  of  the  equation  of 
its  bisector. 
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Discussion  of  the  Solution  to  the  Simultaneous 

Equations .  As  previously  mentioned,  if  the  bisector  is  not 

vertical  or  horizontal ,  its  endpoints  are  found  from  the 

simultaneous  solution  of  the  equations  of  the  circumscribing 

circle  and  of  the  bisector.  Since  two  endpoints  are  to  be 

.1  (  *  .  !  u  t  i  <  >  n  •  )  .  t  he  quad!  .  •  i  *  ; .  •  utilized. 

The  following  definitions  are  used  in  the  development  of  the 

solution  to  the  simultaneous  equations: 

CIRCLE  BISECTOR  UNDER  CONSIDERATION 

R  =  Radius  of  the  circle  UMID  =  x-coordinate  of  midpoint 

CX  =  x-coordinate  of  cen-  VMID  =  y-coordinate  of  midpoint 

ter  of  circle 

M2  =  the  negative  inverse  of 

the  slope  of  the  imagi- 

CY  =  y-coordinate  of  cen-  nary  line  connecting  the 

ter  of  circle  two  signal  points 

X  =  x-coordinate  of  point 
of  intersection 

Y  =  y-coordinate  of  point 
of  intersection 

The  equation  of  the  circle  becomes: 

R2  =  (X  -  CX)2  +  (Y  -  CY)2  (85) 

Given  a  point  Z,  (X  ,  Y„)  and  a  point  J,  (X.,  Y.),  the  slope 

z  z  J  J 

of  the  imaginary  connecting  line  would  be  given  by: 


Slope  = 


(86) 


Therefore,  the  slope  of  the  bisector  becomes: 
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M2 


(87) 


The  point-slope  form  of  the  equation  of  a  straight  line  is: 


Y  -  Y11  =  (Slope)(X  -  Xn) 


(88) 


Substituting  UMID  and  VMID  for  and  and  M2  for  the 

slope,  the  equation  of  the  bisector  becomes: 

Y  =  (M2 ) ( X  -  UMID)  +  VMID  (89) 

The  values  of  R,  CX,  CY,  M2,  UMID,  and  VMID  are  known,  and 
the  problem  is  reduced  to  that  of  two  unknowns,  X  and  Y,  and 
two  equations.  The  quadratic  formula  is  used  to  solve  for 
the  value  of  one  x-coordinate,  and  then  its  corresponding 
y-coo* dinate  is  determined.  Then  the  other  x-coordinate  and 
its  y-coordinate  are  computed.  As  a  point  of  interest,  the 
equations  for  the  variables  A,  B,  and  C  of  the  quadratic 
formula  become : 

A  =  1.0  +  (M2)2  (90) 

B  =  ( 2 ) (M2 ) (VMID)  -  2(CX)  -  (2)(M2)2(UMID) 

-  ( 2 ) ( CY ) ( M2 )  (91) 

C  =  (CX)2  +  (CY)2  -  (R)2  -  (2) (M2) (UMID) (VMID) 

+  (M2)2(UMID)2  +  (2 ) (CY)(M2 ) (UMID) 

-  (2)(CY)(VMID)  +  (VMID)2  (92) 
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Prior  to  solving  for  the  x  and  y-coordinate  values, 

however,  a  check  is  made  to  assure  that  the  term  under  the 

2 

radical  in  the  quadratic  formula,  B  -  4AC  ,  is  positive. 

An  error  terminating  the  program  execution  would  occur  if 
this  term  were  negative;  hence,  should  this  condition  be 
found,  an  error  message  is  provided  and  program  returns  to 
the  beginning.  As  previously  mentioned,  once  the  coordi¬ 
nates  of  the  endpoints  of  all  the  bisectors  have  been  deter¬ 
mined,  they  are  stored  in  matrix  IN. 

Subroutine  POINTS.  The  function  of  this  subroutine 
is  to  determine  the  coordinates  of  the  points  of  intersection 
of  all  the  bisectors.  Subroutine  BISECT  has  computed  the 
endpoints  of  all  the  bisectors  and  since  any  line  can  be 
described  by  two  points,  the  equation  of  each  bisector  is 
known.  This  subroutine  considers  all  possible  combinations 
of  two  bisectors  and  the  simultaneous  solution  of  their 
equations  provides  the  coordinates  of  the  point  of  intersec¬ 
tion.  Several  simplifying  checks  are  performed  first,  how¬ 
ever.  For  example,  if  either  of  the  bisectors  under  consid¬ 
eration  is  vertical,  then  the  y-coordinate  of  the  point  of 
intersection  is  known  and  inserting  this  into  the  equation 
of  the  nonvertical  bisector  easily  provides  the  coordinates 
of  the  point  of  intersection.  Several  other  simplifying 
conditions  can  exist  and  subroutine  POINTS  checks  the 


following : 


1.  First  bisector  vertical? 

2.  Second  bisector  vertical? 

3.  First  bisector  horizontal? 

4 .  Second  bisector  horizontal? 

5.  Bisectors  parallel? 

The  reader  is  invited  to  analyze  the  subroutine  flowchart  to 
discover  in  what  order  these  tests  are  made  and  how  the 

,  1  : ;  :  an  :  r,  i;,ci  .  tlus<  t'-.-t.-  ;  "•  n«  ressiry 

in  many  instances  (particularly  when  the  bisectors  are  ver¬ 
tical)  in  order  to  prevent  division  by  zero  when  the  slopes 
are  infinite.  Before  a  computed  point  of  intersection  is 
stored  in  matrix  IN,  one  final  check  is  performed.  If  the 
bisectors  are  parallel,  there  is,  of  course,  no  point  of 
intersection.  It  is  also  possible  that  the  point  of  inter¬ 
section  may  exist  outside  the  circumscribing  circle.  There¬ 
fore,  the  final  check  is  to  assure  that  only  points  within 
the  circle  are  stored,  otherwise  the  initialized  value  "PHI" 
is  retained  to  designate  that  no  usable  point  of  intersection 
exists.  The  use  of  subroutine  SCALER  would  allow  for  the 
dimensions  of  the  window  (hence  the  circumference  of  the 
circle)  to  increase  and  thus  allow  those  points  previously 
outside  the  circle  to  be  enclosed  in  the  enlarged  circle. 

Subroutine  REGION.  This  subroutine  determines  which 
of  the  points  of  intersection  found  in  subroutine  POINTS  are 
actually  the  endpoints  of  the  line  segments  which  make  up 
the  decision  boundary  lines.  Matrix  IN  has  been  constructed 
such  that  each  time  it  is  filled  in  for  a  particular  lead 
point,  it  contains  the  coordinates  of  the  points  of 


intersection  of  all  the  bisectors  associated  with  that  lead 


point.  Since  the  signal  probabilities  are  not  necessarily 
equally  likely,  the  concept  of  equal  distance  for  determin¬ 
ing  the  decision  boundaries  is  not  valid.  The  diagram  below 
will  be  used  to  demonstrate  th<  procedure  used  in  subroutine 
'  T  .  Ti,.  s;  •  .  -  ; 

points  A,  B,  0.  and  D.  The  si>:  bisectors  have  been  drawn  in 
and  labelled  AB ,  AC,  AD,  BC ,  BD ,  and  CD  and  the  appropriate 
segments  of  the  bisectors  darkened  to  indicate  the  actual 
decision  region  boundaries. 


Fig  6.  Bisectors  and  Decision  Boundaries 
for  Sample  Signal  Set 
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As  is  easily  seen,  each  boundary  segment  separates 
only  two  signal  points  (unless  one  bisector  should  overlay 
another).  The  basic  idea  then  is  to  pick  a  signal  point 
(again  called  the  lead  point)  and  analyze  all  of  its  bisec¬ 
tors.  The  segment  of  any  bisector  which  could  be  part  of 

•  ’  :  •  !  ha  :  :  ■  -  ■  ■  '  !• .  - 

os t  to  the  lead  point.  Looking  at  Figure  6.  we  see  that  for 
signal  "A",  the  portion  of  bisector  "AB"  above  intersection 
Point  1  is  part  of  the  boundary.  There  is  no  other  segment 
of  any  bisector  of  "A"  which  is  closer  to  "A".  However,  for 
the  portion  of  bisector  "AB"  below  Point  1,  bisector  "AC"  is 
closer,  hence  the  decision  boundary  "bends"  at  this  point  of 
intersection.  This  subroutine  thus  checks  each  point  of 
intersection  on  each  bisector  (in  effect,  checking  each  line 
segment)  for  the  condition  above. 

The  algorithm  takes  each  of  the  bisectors  in  matrix 
IN  one  at  a  time  and  successively  considers  each  point  of 
intersection  on  that  bisector.  It  then  computes  the  slope 
of  an  imaginary  line  (called  here  a  "connector")  which  con¬ 
nects  the  lead  point  and  the  point  of  intersection.  Taking 
each  of  the  other  bisectors  of  that  lead  point  in  turn,  it 
determines  the  point  of  intersection  of  the  connector  and 
this  next  bisector.  (This  point  of  intersection  will  be 
called  point  new).  If  point  new  is  between  the  lead  point 
and  the  original  point  of  intersection,  then  the  original 
point  of  intersection  cannot  be  a  boundary  segment  endpoint. 


If  point  >;<  u,'  ia  not  between  the  lead  point  and  the  original 
point  of  intersection,  then  the  next  bisector  is  considered. 
If  all  the  other  bisectors  art'  considered  and  no  other 
bisector  is  found  to  be  closer,  then  the  original  point  of 
intersection  is  an  endpoint  of  a  decision  boundary  segment. 

:  i  rdinates  o :  ; ! .  i :  .-in:  rst-c •.  ;  r-  • 

a  new  matrix  named  "PPT" .  In  this  way  all  the  points  of 
intersection  on  each  bisector  are  considered  and  PPT  even¬ 
tually  contains  the  coordinates  of  all  the  endpoints  of  the 
decision  boundary  line  segments. 

The  construction  of  matrix  PPT  is  interesting  as  it 
is  used  by  subroutine  DECIDE  to  display  the  decision  bound¬ 
aries  and  subroutine  EXACT  to  compute  the  probability  of 
error  for  each  signal.  In  order  for  subroutine  DECIDE  to 
draw  a  line  segment,  it  needs  to  know  the  coordinates  of 
each  endpoint,  or  two  coordinate  pairs.  This  becomes  the 
basic  structure  of  matrix  PPT.  It  is  a  170  row  by  5  column 
matrix.  The  first  two  columns  always  contain  the  x  and  y- 
coordinates  of  the  starting  point  of  a  line  segment,  and 
columns  three  and  four  contain  the  x  and  y-coordinates  of 
the  end  of  that  line  segment.  Column  five  is  used  to  store 
the  number  of  the  lead  point  for  that  particular  line  seg¬ 
ment.  The  170  rows  then  allow  for  a  total  of  170  boundary 
line  segments  to  be  drawn.  The  very  first  boundary  line 
start  point  for  the  first  lead  point  is  put  in  PPT(1,1) 
(x-coordinate)  and  PPT(1,2)  (y-coordinate) .  The  next 
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boundary  line  point  is  put  in  PPT(1,3)  and  PPT(1,4)  as  an 
endpoint  for  that  segment  and  this  same  coordinate  pair  is 
also  put  in  the  first  two  columns  of  the  next  row  of  PPT, 
i.e.,  PPT(2,1)  and  PPT(2,2),  so  that  this  point  becomes  the 
starting  point  for  the  next  line  segment  to  be  drawn.  Con- 

point  are  inserted  in  order  into  matrix  PPT.  This  double 
placement  of  all  remaining  boundary  line  points  lor  this 

lead  point  is  performed  until  all  its  boundary  line  points 
are  stored.  The  very  first  boundary  line  start  point  for 
the  next  lead  point  overwrites  the  last  coordinate  pair  in 
columns  one  and  two  of  PPT  determined  for  the  first  lead 
point,  since  that  coordinate  pair  is  not  needed  as  a  start 
point.  In  the  manner  for  the  first  lead  point,  all  the 
boundary  line  points  for  this  lead  point  are  stored.  After 
all  the  signal  points  have  been  the  lead  point,  the  opera¬ 
tion  is  complete  and  control  of  the  program  returns  to  main¬ 
line  . 

Subroutine  PERROR.  The  function  of  this  subroutine 
is  to  use  the  concept  of  the  Union  Bound  to  compute  an  upper 
value  for  each  signal's  probability  of  error.  It  considers 
the  probability  of  each  signal,  its  location,  and  the  system 
noise  energy  to  determine  this  value.  The  presentation  in 
Chapter  II  indicated  that  Union  Bound  on  the  system's  total 
probability  of  error  could  be  computed  from  Eq  (74)  which  is 
provided  again  below: 
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From  this  it  is  possible  to  determine  the  probability  of 
error  for  any  signal  in  particular  by  writing  the  equation 
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where  the  substitution  a  =  /N  / 2  has  been  made. 

o 

Subroutine  PERROR  basically  sums  all  the  Q-functions 
for  each  signal  point  (or  value  of  k).  Subroutine  BISECT 
has  computed  the  distances  between  all  the  signal  points  and 
stored  them  in  matrix  DISTA.  This  matrix  is  used  to  obtain 
the  values  of  d^.  Prior  to  computing  a  particular  Q-function 
value,  a  check  is  made  to  determine  if  £  =  k  .  If  so, 
that  particular  Q-function  is  not  computed  and  £  is  incre¬ 
mented  to  perform  the  next  computation.  It  is  important  to 
note  that  the  IMSL  Library  subroutine  used  to  compute  the 
statistics  of  the  Normal  Distribution  returns  the  probability 
that  a  random  variable  is  less  than  some  given  value  Y.  The 
Q-function  is  the  probability  that  a  random  variable  is 
greater  than  that  value  of  Y.  Therefore,  the  Library- 
returned  value  is  subtracted  from  unity  to  obtain  the  correct 
Q-function  value.  After  all  the  Q-function  values  for  a 


particular  lead  point  are  computed,  their  sum  becomes  that 
signal's  union  bound  on  the  probability  of  error  and  is 
stored  in  array  "ERROR".  After  all  errors  have  been  com¬ 
puted,  program  control  returns  to  mainline. 

Subroutine  EXACT.  The  function  of  this  subroutine 

error  for  each  signal  and  the  system  as  a  whole.  This  more 
accurate  probability  is  the  risult  of  actually  integrating 
( to  a  close  approximation)  the  decision  area  of  each  signal. 
To  accomplish  this,  the  subroutine  uses  matrix  PPT  to  pro¬ 
vide  the  coordinates  of  the  endpoints  of  the  line  segments 
which  make  up  the  decision  boundary  regions.  The  area 
bounded  by  each  signal  is  computed  using  the  IMSL  Library 
subroutine  for  the  Bivariate  Normal  Distribution.  This  area 
is  then  subtracted  from  unity  to  provide  the  probability  the 
signal  falls  outside  the  signal’s  boundaries,  hence  the 
probability  of  error. 

The  scale  is  enlarged  to  assure  that  all  boundary 
intersections  are  within  the  circumscribed  region.  Then 
each  signal  is  considered  in  turn  and  the  entire  signal  set 
is  translated  so  that  the  signal  in  question  is  located  at 
the  origin.  This  is  done  in  order  to  normalize  the  resulting 
computation  of  the  density  function.  Subroutine  CMPUTE  is 
called  to  provide  the  decision  boundaries  for  the  translated 
signal  set.  The  rows  of  PPT  which  pertain  to  the  signal  in 
question  are  determined,  and  from  these  sets  of  coordinates 
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the  maximum  and  minimum  y-coordinate  values  are  found.  To 
compute  the  area  of  the  signal's  bounded  region,  the  region 
is  separated  into  numerous  rectangles  and  the  areas  of  these 
are  computed  and  summed.  The  rectangles  are  determined  as 
f ol lows . 

\ !  i  ma;;  i  na  ry  lie  r  .  ■  .  ..  1  .  :  i  t  i  >  • 

minimum  y-coordinate  value  found  above  and  successively 
moved  up  by  an  incremented  amount.  As  the  line  is  moved  up, 
the  x-coordinate  values  of  the  points  of  intersection  of 
this  horizontal  line  and  the  boundary  segments  are  deter¬ 
mined  (see  Figure  7).  These  x-coordinates  become  the  X- 
limits  of  integration  and  the  y-coordinates  of  integration 
are  the  value  of  the  horizontal  line  and  the  next  (incre¬ 
mented)  position  of  the  horizontal  line.  If  there  is  only 
one  boundary  line  (e.g.,  the  other  limit  is  at  infinity), 
the  area  is  integrated  out  to  five  standard  deviations  (STD). 

For  each  small  rectangular  area  computed,  four  actual 
integrations  are  required.  This  is  necessary  because  the 
IMSL  routine  used,  MDBNOR,  computes  the  Bivariate  Normal 
Distribution  only  from  negative  infinity  in  both  dimensions 
to  the  point  (X,Y).  Hence,  since  the  lower  limits  cannot  be 
specified,  there  are  areas  included  in  the  computation  which 
must  be  subtracted  off.  The  figure  shows  a  sample  rectangu¬ 
lar  region  in  red  with  single  hash  marks.  In  order  to 
determine  the  area  of  this  rectangle,  first  the  area  of 
everything  below  and  left  is  computed  using  the  bounds 


XUPPER  and  YUPPER  as  the  limits  of  integration.  Secondly, 
from  this  total  area,  both  areas  of  double  .ash  marks  must 
be  subtracted.  Hence  the  area  bounded  by  XUPPER  and  YLOWER 

(Area  2  with  boundary  — - •),  and  the  area  bounded  by 

XLOWER  and  YUPPER  (Area  3  with  boundary . ).  arc  com- 

sub  t  • ;  .  d .  Th  '  •  ■  .  u  •  t  in  :  ■ 

lower  left  portion  bounded  by  XLOWER  and  YLOWER  (Aron  4 )  to 
bt'  subtracted  out  twice.  Therefore,  it  too  is  computed  and 
then  added  back.  Thus,  the  area  of  the  rectangle  is  given 
by  : 

Area  of  Rectangle  =  Total  Area  -  Area  2  -  Area  3 

+  Area  4 

This  result  then  is  stored  and  after  all  the  rectangular 
regions  for  the  signal  in  question  summed,  the  total  is  sub¬ 
tracted  from  unity  to  yield  the  probability  of  error  for 
that  signal. 

The  details  of  the  operation  of  this  routine  will  be 
discussed  as  follows: 

1.  Determination  of  the  limits  of  integration 

2.  Determination  of  variable  incrementing  factor 

3.  Adjustment  of  limits  when  noise  variance  is  not 
equal  to  one 

In  order  to  gain  an  understanding  of  the  algorithm 
used  to  determine  the  limits  of  integration,  a  simple 
example  will  be  discussed.  The  signal  set  to  be  used  is 
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given  by: 


which  is  plotted  as 


Fig  8  Sample  Signal  Set  for  Explanation  of 
Subroutine  EXACT 

For  the  example  of  the  computation  to  be  performed,  the 
probability  of  error  for  Signal  Sg  will  be  described.  It 
will  be  assumed  that  the  wirdow  has  been  properly  scaled. 

As  the  overview  outlines,  the  signal  set  is  translated  so 
that  Signal  2  is  at  the  origin  and  subroutine  CMPUTE  is 
called  to  determine  the  boundary  line  segments  and  their 
endpoints.  If  the  signal  set  were  plotted  and  the  decision 
boundaries  drawn  in  at  this  point,  the  display  would  be 
shown  as  in  Figure  9  with  the  top  of  the  window  at  least 
five  STD  above  Sg. 
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Fig  9.  Translated  Sample  Signal  Set 

Since  column  five  of  matrix  PPT  identifies  to  which  signal 
point  each  row  belongs,  the  rows  associated  with  Signal  2 
are  easily  determined.  From  these  rows,  the  minimum  and 
maximum  y-coordinate  values  are  found.  The  minimum  value 
will  become  the  starting  location  of  the  horizontal  line 
(YLINE)  which  will  sweep  up  over  the  entire  area  bounding 
Signal  2.  The  maximum  value  (YTOP)  will  become  the  ultimate 
limit  of  the  sweep  of  the  YLINE.  With  YLINE  at  its  starting 
position,  the  subroutine  enters  the  top  of  several  loops  to 
determine  the  values  of  the  x-coordinate  limits.  (The  first 
time  through  for  this  example,  YLINE  is  at  y  =  -2.0  and  the 
X-limits  are  identical  so  the  area  equals  zero  and  YLINE  is 
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i ncremented . )  For  the  purposes  of  explanation,  it  will  be 
assumed  that  YLINE  has  been  incremented  to  y  =  -1.0  and  the 
procedure  is  joined  in  progress.  The  routine  considers  the 
first  boundary  segment  of  Signal  2  (that  segment  from  [0,  -2] 
to  the  upper  richt  corner)  and  determines  the  intersection 

i  t  :  r 

point  of  intersection  Jies  numerically  between  the  values  of 
the  x-coordinates  of  the  endpoints  of  the  segment  and  YLINE 
lies  numerically  between  the  values  of  the  y-coordinates  of 
the  endpoints  of  the  segment,  then  this  point  of  intersec¬ 
tion  will  be  a  limit  of  integration.  This  is  Point  1  in  the 
figure.  The  routine  will  then  consider  the  next  boundary 
line  segment  (i.e.,  the  next  row  of  PPT)  and  determine  its 
intersection  with  YLINE.  It  finds  it  to  be  Point  2  in  the 
figure.  The  maximum  of  the  two  limits  becomes  the  X-limit 
of  integration  identified  as  XUPPER  and  the  minimum  becomes 
the  X-limit  named  XLOWER.  These  two  values  are  then  stored 
respectively  as  XUPOLD  and  XLOOLD.  YLINE  is  incremented 
and  the  next  two  values  for  the  X-limits  computed.  These 
two  values,  named  XUPNEW  and  XLONEW  are  compared  with  the 
two  previous  quantities.  The  lesser  of  XUPNEW  and  XUPOLD 
becomes  the  value  of  XUPPER  and  the  greater  of  XLONEW  and 
XLOOLD  becomes  the  value  of  XLOWER  used  in  the  integration. 
This  assures  that  the  integrated  probability  of  a  correct 
decision  as  computed  is  slightly  less  than  the  actual 
probability.  Thus,  the  probability  of  error  that  results 
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will  always  be  slightly  greater  than  the  actual  probability 
of  error  and  we  are  assured  of  an  upper  bound.  The  current 
value  of  YLINE  becomes  the  value  of  YUPPER  and  decrementing 
this  quantity  yields  the  value  of  Y LOWER .  With  these  four 
vm1uos  determined,  the  integration  process  described  in  the 
r  i  ed  e  •  •  ; 

routine  starts  again  with  the  top  of  the  "X- limit"  determin- 
•  ng  loops .  Tor  the  example  under  consideration,  YLINE  will 

continue  to  sweep  up  the  Signal  2  region  stopping  at  each 
increment  to  have  new  X-limits  determines  and  more  and  more 
rectangular  areas  integrated.  It  will  stop  when  it  reaches 
a  value  equal  to  either  YTOP,  which  would  mean  that  the  top 
of  the  bounded  region  has  been  reached,  or  when  it  is  equal 
to  the  value  of  five  STD.  (Five  STD  is  set  as  an  automatic 
limit  because  negligible  area  exists  any  further  up.) 

The  reader  will  note  that  several  other  configura¬ 
tions  for  the  decision  region  boundaries  are  possible.  Each 
of  these  is  dealt  with  at  an  appropriate  location  in  the  sub¬ 
routine  and  the  interested  reader  is  urged  to  follow  the 
flowchart  for  the  actual  implementation.  However,  the  possi¬ 
bilities  will  be  identified  below  and  the  actions  taken  by 
the  routine  described. 

The  first  condition  which  may  occur  is  that  all 
boundary  segments  may  be  checked  using  a  particular  value  of 
YLINE  and  no  X-intersections  are  found.  This  implies  the 
signal  under  consideration  has  only  one  boundary  segment 
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and  it 


in  iact ,  is  horizontal . 


Since  the  values  of  YLINL 


and  YTOP  will  be  equal  (that  is,  equal  to  the  y-coordinate 
value  of  the  boundary  segment),  the  starting  value  for  YLINE 
and  the  value  for  YTOP  must  be  assigned  automatically.  In 
ord<r  to  chi  this,  a  check  is  made  to  determine  if  the  bound- 

■  • '  -  r  • 

boundary  is  above  the  signal  point.  YLINI'  is  set  .'trial  to  a 
negative  five  STD  and  YTOP  is  set  equal  to  the  lesser  of 

the  y-coordinate  value  of  the  boundary  or  a  positive  five 
STD.  Conversely,  if  the  boundary  is  below  the  signal  point, 
YLINE  is  set  equal  to  the  greater  of  the  y-coordinate  value 
of  the  boundary  or  a  negative  five  STD  and  YTOP  becomes 
equal  to  positive  five  STD.  Since  there  are  no  computed 
limits  on  the  values  of  X,  the  routine  automatically  assigns 
XLOIVER  equal  to  a  negative  five  STD  and  XUPPER  equal  to  a 
positive  five  STD. 

A  second  special  condition  occurs  when  all  the 
boundary  segments  are  checked  using  a  particular  value  of 
YLINE  and  only  one  X-intersection  is  determined.  This  again 
implies  that  the  signal  point  has  only  one  boundary  segment, 
but  that  the  boundary  this  time  is  inclined.  In  this 
instance,  another  check  is  required.  This  additional  check 
(named  XCHECK)  determines  on  which  side  of  the  signal  point 
the  boundary  line  rests.  If  the  boundary  is  to  the  left  of 
the  signal  point,  XLOWER  becomes  the  value  of  the  x-coordinate 
of  the  point  of  intersection  and  XUPPER  is  automatically 
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assigned  to  be  a  positive  five  STD.  If  the  boundary  is  to 
the  right  of  the  signal  point,  the  opposite  situation 
occurs,  and  XLOWER  is  automatically  set  to  a  negative  five 
STD. 

Du<j  1o  the  nature  of  the  construction  of  matrix  PPT, 

1 i  segr 

enco  (particularly  if  any  bisectors  happen  to  overlay  one 
another).  Additionally,  a  particular  boundary  line  segment 

may  be  duplicated  but  with  its  endpoints  reversed.  For  these 
reasons,  after  the  first  X-limit  is  found,  every  future 
boundary  line  segment  considered  is  first  checked  for  either 
of  the  conditions  above.  Unless  the  segment  is  distinct  from 
the  first  usable  boundary  segment,  it  will  be  rejected  and 
the  search  will  continue. 

This,  then,  is  the  embodiment  of  subroutine  EXACT. 
Regardless  of  the  shape  of  the  bounded  region,  a  starting 
location  for  YLINE  is  determined  and  it  step  by  step  works 
its  way  up  to  and  over  the  signal  point  in  question,  creating 
rectangular  regions  which,  when  summed,  equal  the  probability 
of  a  correct  decision  being  made.  This  value  subtracted  from 
unity  results  in  the  probability  of  error. 

The  second  specific  operation  of  subroutine  EXACT  to 
be  discussed  is  the  determination  of  the  variable  increment¬ 
ing  factor.  Due  to  the  nature  of  the  Bivariate  Normal  Dis¬ 
tribution  Function,  the  use  of  a  constant  value  to  increment 
YLINE  is  inefficient.  This  is  because  the  further  one  moves 
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from  the  signal,  the  smaller  the  value  of  the  function,  and 
hence  the  smaller  the  computed  area  of  a  rectangular  region. 
Therefore,  when  YLINE  is  at  the  extremes  of  its  movement, 
the  value  of  the  increment  must  be  its  largest;  as  YLINE 
approaches  the  signal,  the  incrementing  value  must  be  made 
smaller.  This  results  in  a  closer  approximation  to  the 
actual  value  of  the  function  within  the  bounded  region. 

Note  the  simplified  diagram  below: 


Fig  10.  Diagram  of  Variable  Incrementing  Value 

There  are  three  critical  variables  which  must  be 
considered  when  designing  this  "sliding"  computation.  First, 
what  is  the  initial  incrementing  value  to  be?  Second,  what 
criterion  should  be  used  to  initiate  a  change  of  value?  And 
finally,  how  much  should  this  value  be  reduced  and  then 
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enlarged?  The  answers  to  all  three  of  these  questions  could 
become  a  thesis  in  their  own  right.  The  numerical  analysis 
required  for  the  most  efficient  combination  for  all  possible 
signal  sets  would  be  enormous.  However,  one  can  use  the 
Tables  of  the  Circular  Bivariate  Normal  Distribution,  experi- 
with  the  routine,  and  much  trial  and  error  and  arrive 
at  a  relatively  acceptable  set  of  answers.  The  results  used 
in  the  subroutine  are  as  follows: 

1.  In  the  interest  of  using  the  smallest  amount  of 
CPU  time  and  yet  still  striving  for  as  close  an  approxima¬ 
tion  as  possible,  the  initial  incrementing  value  is  equiva¬ 
lent  to  one  one-hundredth  (0.01)  of  the  total  length  traversed 
by  YLINE  (i.e.,  YTOP  -  YBOT) . 

2.  The  criterion  used  to  initiate  a  change  of  the 
incrementing  value  is  the  value  of  the  function  returned. 

As  YLINE  nears  the  signal  point,  the  value  of  the  function 
or  the  area  of  the  rectangles  increases,  indicating  a  need 
to  take  more  samples  or  decrease  the  incrementing  value.  A 
problem  arises  here,  for  if  the  incrementing  value  is 
decreased  too  much  or  too  quickly  or  both,  the  value  of  the 
function  will  again  be  very  low,  thus  signaling  a  need  to 
prematurely  increase  the  incrementing  value.  This  would 
cause  an  oscillation  of  the  incrementing  value  which  is 
clearly  undesirable  and  leads  to  greater  inaccuracies  than 
using  a  simple  fixed  incrementing  value.  Since  the  accuracy 
of  the  value  of  the  function  returned  by  the  IMSL  subroutine 


87 


used  to  compute  the  density  is  given  as  0.00001,  this  is 
the  value  used  to  signal  the  first  decrease  in  the  incre¬ 
menting  value.  The  next  level  used  is  ten  times  this,  or 
0.0001,  and  the  last  step  occurs  when  the  returned  value  of 
the  function  is  100  times  greater  than  the  initial  value  or 
0.001 . 

3.  The  final  consideration  is  the  amount  the  incre¬ 
menting  value  should  be  decreased.  It  was  found  that  simply 
halving  the  value  at  each  step  appeared  to  provide  adequate 
tracking . 

Lastly,  in  order  to  provide  the  capability  to  obtain 
an  even  closer  approximation  (hence  greater  resolution),  any 
or  all  of  these  factors  could  be  made  to  vary  according  to 
the  user's  desires.  It  became  a  design  decision  to  allow 
only  the  first  variable  to  be  user  altered  and  even  this  is 
still  not  solely  his  choice.  The  closer  approximation  is 
computed  by  allowing  the  integrations  to  be  more  closely 
spaced.  This  is  accomplished  by  allowing  the  user  to  succes¬ 
sively  halve  the  initial  incrementing  value,  perform  the 
operation,  and  check  the  results.  This  procedure  can  be  con¬ 
tinued  indefinitely  (assuming  one  has  unlimited  CPU  time). 
Hence,  the  user  is  allowed  to  obtain  the  more  accurate 
answer,  but  not  at  the  expense  of  attempting  to  "reinvent  the 
wheel . " 

The  third  special  operation  of  subroutine  EXACT, 
which  will  be  explained,  is  the  adjustment  of  the  limits  of 
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integration.  For  the  reasons  discussed  below,  these  limits 
must  be  adjusted  whenever  the  noise  power  spectral  density 
or  variance  (i.e.,  variance  of  the  probability  distribution) 
is  not  unity. 

The  Bivariate  Normal  Distribution  Function  is  given 

by  : 


P(x,v)  = 


27TCT  a  /l-p^ 
x  y 


I  1 

exp  <  - 


2( 1-p  ) 


X- iJ 


L 


-  2 


(x-yx)(y-yy)  +  (y-yy 
axay 


(93) 


For  this  project,  the  assumptions  allow  the  following 
simplifications : 


p  =  0 


a 


which  result  in  the  following  representation  for  this  func¬ 
tion: 


P(x,y)  - 


2ir  o' 


exp 


■ 

2  2 

*  +  L. 

2 

2  2 
a  a 

(94) 


The  IMSL  subroutine  MDBNOR,  which  computes  the  Bivariate 

Normal,  additionally  assumes  that  the  variance  equals  one, 
2 

o  =  1.0  .  It,  therefore,  computes  the  following  density: 
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v  »  —  and  w  * 

a  a 

dv  =  -1-dx  and  dw  =  -dy 

dx  *  a dv  and  dy  =  odw 

By  substitution  into  Eq  (97)  above,  we  have: 
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frlil 


■  \  >  -  / 


2t\o‘ 


)  ) 

—  OO  —CO 


l  VI J 


exp 


w 

2 


odw 


(98) 


1  :  r\  i  •  ami  adjusting  the  limits  results  in: 


p(v,w) 


dw 

(99) 


This  is  the  desired  form  and  implies  that  the  only  "correct¬ 
ing  factor"  necessary  is  an  adjustment  to  the  limits  of 
integration.  That  is,  each  limit  must  be  multiplied  by  ^  in 
order  to  correct  for  the  noise  variance  equalling  something 
other  than  unity.  Subroutine  EXACT  uses  the  substitution, 

T  =  ^  ,  to  simplify  the  expression. 

Subroutine  CMPUTE .  This  subroutine  forms  the  basis 
for  the  computation  and  display  of  the  decision  regions . 
Given  the  particular  signal  set  and  the  scaling  factor,  it 
calls  subroutine  WINDOW  to  calculate  the  dimensions  of  the 
window  and  the  equation  of  the  circumscribing  circle.  Then 
using  successive  calls  to  subroutines  BISECT,  POINTS,  and 
REGION,  it  determines  which  points  of  the  bisector  intersec¬ 
tions  are  the  endpoints  of  the  segments  which  make  up  the 
decision  boundary  regions. 
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The  initial  call  to  subroutine  WINDOW  is  performed 
only  once  to  calculate  the  window  dimensions  (XMIN,  XMAX, 

YMIN ,  YMAX),  and  the  radius  of  the  circle.  Then,  for  each 
signal  point,  each  of  the  other  three  subroutines  is  called 
in  order.  Subroutine  BISECT  determines  the  equations  of 
;■  1  ;  :  '  •  ■  !  :  :  i  * .  >•.•  I  Or  i  i  pr  >  i  !i  i  .  ;i.  r-'v  t  !:■  -n 

finds  all  the  point.s  of  intersection  for  these  bisectors 
and  subroutine  REGION  determines  which  of  these  points  of 
intersection  should  be  connected  to  display  the  decision 
region  boundaries.  Matrix  IN  is  used  to  store  the  endpoints 
(hence  the  equations)  of  the  bisectors  and  all  the  points  of 
intersection.  Matrix  PPT  is  used  to  store  the  coordinates 
of  the  segment  endpoints.  Hence,  every  time  CMPUTE  is 
called,  the  entire  signal  set  is  considered  and  all  the 
decision  regions  determined. 

Output  Subroutines 

Now  the  program  is  ready  to  prompt  for  the  user 
options.  The  signal  set  can  be  altered,  the  system  para¬ 
meters  changed,  or  the  statistics  and  boundary  regions  for 
the  current  signal  set  displayed.  In  order  to  do  this,  one 
of  the  output  subroutines  must  be  called.  Table  III  lists 
the  output  subroutines  along  with  the  functions  they  perform. 
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TABLE  III 


OUTPUT  SUBROUTINES 


Subroutine  Name 


Function 


PLOT 


Provides  graphical  display  of  signal 
set  and  listing  of  coordinate  pairs 


DEC  i])E 


Provides  graphical  display  of  signal 


OUTPUT  Provides  tabular  listing  of  signal 

and  system  statistics 

EXACT  Provides  the  actual  probability  of 

error  it  has  computed 


Subroutine  PLOT.  The  purpose  of  this  subroutine  is 
to  allow  the  user  to  visually  display  and  check  the  signal 
set  currently  under  consideration.  In  addition  to  a  plot  of 
the  signals,  the  routine  can  also  provide  a  listing  of  the 
signal  set  coordinate  pairs.  Finally,  it  serves  as  the  dis¬ 
play  for  subroutine  ADDGRA,  which  allows  the  user  to  graphi¬ 
cally  add  signal  points.  The  routine  begins  by  clearing 
the  screen  and  displaying  the  X-Y  axis  and  the  window  bound¬ 
ary.  It  then  considers  each  signal  point  in  turn,  moves  the 
cursor  to  the  point  location,  and  then  does  a  small  relative 
movement  to  the  left  and  down  the  screen  in  order  to  center 
the  point  marker,  an  asterisk,  exactly  on  the  signal  point 
location.  Another  small  relative  movement  is  made  and  the 
number  (or  letter,  for  signals  greater  than  nine)  of  the 
signal  is  displayed.  After  all  the  signals  have  been  posi¬ 
tioned,  the  cursor  is  moved  below  the  display  and  a  prompt 
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provided  the  user.  Since  he  may  not  be  interested  in  a 
listing  of  the  coordinate  pairs,  he  is  given  the  choice  of 
clearing  the  screen  and  having  the  listing  provided  or 
leaving  the  subroutine  at  this  point  to  continue  program 

execution.  This  prompt  also  serves  as  a  pause  to  allow  the 

1  ■  '  .  ;  '  u;  l 

Subroutine  PKCIDF.  Subroutine  DECIDE  provides  a 
graphical  display  of  the  signal  set  with  the  computed  deci¬ 
sion  boundaries  displayed.  As  previously  discussed,  the 
subroutines  BISECT,  POINTS,  and  REGION  fill  in  and  alter 
matrices  IN  and  PPT.  The  contents  of  PPT  are  the  endpoints 
of  all  the  segments  of  the  decision  region  boundaries. 

Matrix  PPT  has  five  columns  and  up  to  170  rows.  Columns  one 
and  two  contain  the  x  and  y  coordinates  of  one  endpoint  and 
columns  three  and  four  contain  the  x  and  y  coordinates  of 
the  other  endpoint  of  each  segment  to  be  drawn.  Column  five 
contains  the  number  of  the  signal  point  to  which  this  bound¬ 
ary  segment  belongs  (see  Subroutine  REGION).  The  cells  of 
PPT  are  initialized  to  contain  PHI  and  are  changed  as  the 
endpoints  are  filled  in.  This  routine  checks  columns  one 
and  three  of  each  row  to  assure  a  valid  endpoint,  i.e.,  the 
value  is  less  than  PHI.  If  both  values  are  valid,  a  visible 
line  connecting  the  coordinate  pairs  is  drawn.  Otherwise, 
the  next  row  of  PPT  is  checked  and  so  on  until  all  170  rows 
have  been  considered.  The  routine  then  displays  the  signal 


set  points,  draws  the  window  boundaries,  and  draws  in  dashed 
lines  representing  the  X-Y  axis. 

Subroutine  OUTPUT.  The  function  of  this  subroutine 
is  to  provide  a  tabular  listing  of  all  computed  statistics 
except  the  integrated  probability  of  error  determined  by 
;  !)!■'  i :  ;  "  ' .  . '  ■.;!•••'  •  u'-n-ut  i  *.•  !'V..U'T 

can  use  considerable  CPI1  time,  it  is  relegated  to  a  separate 
option  for  use  with  those  signal  sets  appearing  most  promis¬ 
ing.  Subroutine  OUTPUT  then  gives  the  user  an  expedient 
analysis  of  the  signal  set  at  hand.  Specifically,  for  each 
individual  signal  point,  the  following  data  is  displayed: 

1.  Signal  number 

2.  Coordinate  pair  of  signal 

3.  Signal  probability 

4.  Signal  energy 

5.  Signal-to-noise  ratio 

6.  Union  bound  on  the  probability  of  error 
Additionally,  the  system  statistics  listed  below  are  pro¬ 
vided: 

2 

1.  System  noise  power  spectral  density  (a  ) 

2.  Total  system  signal  energy 

3.  Total  system  probability  of  error  (Union  Bound) 

4.  Coordinates  of  the  system  center  of  gravity 
Due  to  the  range  of  values  possible,  an  E  format,  or  sci¬ 
entific  notation  format,  is  used  in  printing  out  the  values 
of  coordinate  pairs  and  probabilities  of  error.  For  the 
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values  of  signal  probabilities,  their  energies,  and  SNR,  a 
decimal  format  is  used. 

Discussion  of  Matrix  IN 

Matrix  IN  (for  intersection),  is  a  large  matrix 
(34  x  OJ )  which  is  an  integral  element  of  subroutine  BISECT, 
POINTS,  and  RLuluX.  An  understand!  n>,  of  its  construction 
is  t-sst  in  iai  io  an  understanding  <>i  these  routines.  Basi¬ 
cally,  it  is  a  matrix  which  contains  all  the  coordinate 
pairs  of  the  points  of  intersection  of  the  perpendicular 
bisectors  and  a  circle  which  circumscribes  the  signal  set  and 
the  bisectors  .  The  word  bisectors  is  italicized  because  the 
lines  will  only  be  bisectors  when  the  probabilities  of  the 
two  signals  it  separates  are  equal.  However,  the  term  will 
continue  to  be  used  with  the  understanding  that  the  location 
of  the  perpendicular  boundary  line  will  be  shifted  toward 
the  signal  having  the  smaller  probability  of  occurrence  when 
the  probabilities  are  not  equal. 

Subroutine  BISECT  determines  the  coordinates  of  inter¬ 
section  of  each  bisector  and  an  imaginary  circle  which  cir¬ 
cumscribes  the  signal  set.  The  first  row  of  IN  contains  the 
x  and  y-coordinates  of  one  end  of  each  bisector.  The  second 
row  of  IN  contains  the  x  and  y-coordinates  of  the  other  end 
of  each  bisector. 

Subroutine  POINTS  uses  these  endpoints  to  determine 
the  equations  of  all  the  bisectors.  It  then  determines  all 
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the  coordinates  of  all  the  points  of  intersection  of  the 
bisectors  which  fill  out  the  rest  of  IN. 


Mapped  out,  Figure  11  shows  how  the  points  of  inter¬ 
est  are  inserted  in  IN  for  a  four  point  signal  set.  The 
number  of  bisectors  between  Point  1  and  the  other  three  sig- 
'  .  ’  ’  r, :  ..i<,  ;  .  .  .  •>- 1  .  IP  ?:e.  ■  !  1  u:  , 

becomes  (n-1)  x  2  to  allow  for  the  x  and  y-coordi na i es  of 
each  endpoint.  The  number  of  rows  is  (n-1)  +  2  because  in 
addition  to  the  bisector  points  of  intersection,  the  end¬ 
points  of  each  bisector  are  in  rows  one  and  two.  The  number¬ 
ing  of  the  bisectors  is  demonstrated  in  the  figure,  and  shows 
that  the  lead  point  is  fixed  and  the  second  point  is  incre¬ 
mented  until  the  entire  signal  set  is  considered.  After  all 
the  operations  and  computations  for  the  first  lead  point 
have  been  accomplished,  the  matrix  is  reinitialized  and  used 
for  the  next  lead  point.  In  this  fashion,  all  the  signal 
points  are  processed. 
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Program  Yeriiicat i on 


IV  . 


Introduction 

In  order  to  completely  verify  this  program,  one 
would  b<-  I'ov'i'd  1  <>  test  every  conee  i \a  1  > !  i  ■  rombinnl  ion  of 

1  a  si  .  •  •  ' 

settling  for  a  test  of  c>n!y  the  extreme  values  o!  oacli  vari¬ 
able.  1  >u t  oven  this  would  be  an  enormous  undertaking.  How¬ 
ever,  as  a  tutorial  tool,  rather  than  a  commercial  product, 
the  primary  interest  should  be  how  well  the  program  performs 
with  a  set  of  "typical  inputs."  It  is  essential  that  it  be 
able  to  properly  process  the  kinds  of  operations  or  signal 
set  manipulations  which  a  curious  student  may  be  inclined 
to  investigate. 

For  these  reasons,  the  program  verification  consists 
of  the  comparison  of  solutions  for  a  tutorial  problem.  The 
statement  of  the  problem  is  given,  the  hand  calculated  solu¬ 
tions  explained,  and  then  the  program  generated  results 
presented  and  compared.  Part  one  of  the  verification  begins 
with  a  description  of  the  initial  problem  signal  set  and  a 
comparison  of  the  results  obtained  by  the  two  methods.  Next 
the  system  noise  energy  will  be  varied  and  the  two  solutions 
again  compared.  Returning  to  the  original  problem,  the 
individual  signal  probabilities  will  be  varied  and  the 
solutions  analyzed.  The  final  set  of  comparisons  is  for 
the  results  when  a  signal  of  the  original  set  is  deleted  and 
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a  new  signal  added.  In  this  manner,  the  majority  of  the 
mathematical  aspects  of  the  program  will  be  tested. 

A  major  objective  of  the  project  is  the  selection  of 
an  optimum  signal  set.  Since  the  criterion  of  optimization 
ch'iscn  is  the  probability  of  error  criterion,  part  two  of 
i  '  :  >  ..  ! . 

Two  important  aspects  of  this  computation  are  shown.  First, 
tin-  amount  of  deviation  in  the  calculated  value  as  the  signal 
set  is  rotated  is  presented  and,  second,  the  fact  that  the 
calculated  value  is  always  an  upper  bound  is  verified. 

Part  three  tests  a  third  essential  purpose  of  the 
program:  the  graphical  display  capability.  The  verifica¬ 

tion  of  the  graphics  consists  of  the  display  of  a  sample 
signal  set  and  demonstrates  the  results  of  translation, 
rotation,  and  scaling  of  this  signal  set. 


Manipulation  of  Signal  and  System  Parameters 

Sample  Problem  and  Initial  Comparison.  In  a  quadri- 
phase  communication  system,  the  four  signal  vectors  are 
given  as 


S1  = 


S4  = 


Figure  12  is  a  graphical  representation  of  this  signal  set. 
Initially,  the  signals  are  equiprobable  and  the  noise  vari¬ 
ance  is  unity.  The  statistics  we  wish  to  compute  and  com¬ 
pare  are  the  signal  energies,  signal-to-noise  ratios,  the 
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union  bound  on  the  probability  of  error,  and  the  actual 
probability  of  error.  From  the  symmetry  of  the  given  signal 
set,  it  is  obvious  that  the  statistics  of  each  signal  will 
be  the  same.  Therefore,  only  one  signal  need  be  considered. 
The  Handbook  of  Tab! os  for  Mat  hemnti cs  is  used  to  determine 

■  9;  92' ■ .  ‘'2.9  )  . 


Fig  12.  Quadriphase  Signal  Set  Used  For  Verification 

1.  Signal  Energy.  From  Eq  (79),  we  recall  the 
energy  of  a  signal  is  computed  as  follows: 
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(79) 


2  2 

Energy  =  ( x-coordinate )  +  ( y-coordi nate ) 

Therefore,  if  the  signal  vectors  are  measured  in  volts 
across  a  resistance  of  one  ohm,  their  energy  is: 


2.  2  ;  n..  i  -  to-’.'-,  i  <  Ratio.  i'rcu  )  e  (  7S  )  ,  i  he 

:  ignal -to-noi so  ratio  (SNR)  is  defined  as: 


E  E 

JT  I  «»  =  10  ‘<*io  JT 

o  o 


(78) 


which  gives  a  SNR  for  each  signal  of 


(  db  =  10  log1Q  |  =  6.0206  db 
o 


3.  Union  Bound  on  the  Probability  of  Error.  To 
determine  the  union  bound,  we  must  first  compute  the  dis¬ 
tances  between  every  combination  of  two  signals.  Either  by 
direct  computation  from  Eq  (65)  or  by  inspection  of 
Figure  12,  it  is  easy  to  establish  that  the  distances  are 
as  given  in  Table  IV. 
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TABLE  IV 


Distances  of  Signal  Set  Used  for  Verification 


l 


k 

1 

2 

3 

4 

1 

1 

- 

4 

4/2 

4 

1 

- 

1 

i  k  L! 

3 

•i  ,  2 

•1 

- 

i 

■1 

1 

4/2 

4 

_ 

Using  these  in  Eq  (66),  the  union  bound  on  the  Pg  for  each 
signal  becomes 


K 

P  { e  |  m.)  <  X  Q 
K  1=1 
SL?k 


£k 

2o 


(66) 


P  {  e  |  m.  }  <  Q( 2 )  +  Q(2/2)  +  Q(2)  =  0.0479 


4.  For  this  particular  signal  set,  it  is  possible 
to  compute  the  exact  value  of  the  probability  of  error.  For 
example,  if  message  m^  is  sent,  no  error  will  be  made  unless 
n^  or  ng  is  greater  than  2.0.  Therefore,  it  can  be  shown 
(Ref  3:118),  that  the  conditional  probability  of  error  is 
given  by 

PUjn^}  =  2Q( 2 )  -  Q2(2)  =  0.0449 


Figure  12  also  shows  the  decision  region  boundaries  for  this 
signal  set.  Due  to  symmetry,  the  <j>^  and  axes  actually 


represent  these  boundary  lines.  Table  V  provides  the  pro¬ 
gram  computed  results  for  this  problem.  The  data  listed 
under  OPTION>  9  for  signal  energy,  SNR,  and  the  union  bound 
are  nearly  identical,  as  any  differences  are  attributable 
to  round-off  error.  OPTION>  12  provides  the  program  ealeu- 

.  i  •  !  ;  !  r  .  n  ,  *  ,  •  .  •  ’  ;  .  •  •  ; 

t  h  i  particular  (symmetric)  signal  set,  the  two  computations 
are  i dent ical  . 

Variation  One:  Altering  Noise  Energy.  The  signal 
set  for  this  example  remains  the  same;  however,  in  this  case 
we  vary  the  system  noise  energy.  From  the  default  value  of 
2.0,  we  choose  to  increase  it  to  8.0  and  examine  the  effects 
on  the  system  statistics. 

1.  Signal  Energy.  Since  the  signals  have  not  been 
altered,  no  change  in  their  energy  is  possible. 

2.  Signal-to-Noise  Ratio.  Referring  to  Eq  (78) 
once  again,  the  adjusted  SNRs  become 

E 

|  db  =  10  log10  |  =  0.0  db 
o 

3.  Union  Bound  on  the  Probability  of  Error.  Since 

the  signal  set  has  not  been  altered,  the  distances  in 

Table  IV  are  still  valid.  A  noise  energy  of  8.0  yields  a 

2 

noise  variance,  a  ,  of  4.0;  hence,  the  value  of  a  used  in 
Eq  (66)  must  be  2.0.  The  union  bound  given  by  this  equa¬ 
tion  thus  becomes 
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r 


for  Verification 


fOJAL  SYSTEM  PROD  ABILITY  OF  ERROR’  l  <  .  4  4  VO  E -01. 


P{e|mk)  <  2Q( 1)  +  Q(/2)  =  0.3964 


4.  The  exact  probability  of  error  is  found  in  a 
manner  similar  to  the  previous  example.  As  described  in 
Chapter  III,  Eq  (99),  the  limits  of  integration  must  be 
multiplied  by  -jj;  therefore,  if  message  is  sent,  no  error 
will  be  made  unless  n^  or  n ^  is  greater  than  2(^) ,  or  1.0. 
Hence,  the  exact  probability  of  error  becomes 

P(e| m^}  =  2Q( 1)  -  Q2(l)  =  0.2922 

The  program  calculated  results  for  this  problem  are  located 
in  Table  VI.  OPTION>  9  contains  the  signal  and  system 
statistics  for  comparison.  Again,  the  agreement  with  the 
manually  obtained  results  is  excellent.  As  before, 

OPT I ON >  12  gives  the  integrated  value  of  P  ,  and  since  the 
signal  set  is  still  symmetric,  the  two  results  are  nearly 
identical . 

Variation  Two:  Altering  Signal  Probabilities.  For 
this  particular  variation,  only  the  signal  probabilities 
will  change.  The  system  noise  variance  is  restored  to  unity 
and  the  signal  set  remains  the  same.  The  probabilities  we 

w  i  1 1  co  n  s  i  de  r  a  re 

P{s1}=0.01  P{s2}=  °'04  P(Sg}=  0.2  P{s4)=0.75 

1.  Signal  Energy.  No  change  in  signal  energy  has 
been  made. 
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Statistics  of  Variation  One 


PROBABJLII  <  OF  L-RROR  i 


2.  Signal-to-Noise  Ratio.  Because  the  original 
value  of  the  system  noise  energy  is  used,  the  SNR  will 
return  to  the  initially  computed  value  of  6.0206  db. 

3.  Union  Bound  on  the  Probability  of  Error.  Since 
the  signal  probabilities  are  no  longer  equally  likely, 

Eq  (66)  cannot  be  used.  Instead,  we  refer  to  Eq  (75)  given 
below: 

K 

P  { e  |  m.  }  <  E  Q 
K  A=1 

Note  that  the  distances  of  Table  IV  remain  valid  and  we  can 
proceed  with  the  calculation  for  signal  s*.  By  substitution 
of  the  parameters  into  Eq  (75),  we  have  P{e|m1>  <  0.2390 
In  a  similar  fashion,  the  remaining  values  are  computed  and 
are  given  below: 

P{e|m2}  =  0.0744 
P{e(m3}  =  0.0561 
P{ejm4>  =  0.0113 

4.  The  computation  of  the  exact  Pg  becomes  more 
difficult  in  this  variation.  The  signals  are  no  longer 
equiprobable  and  the  perpendicular  bisectors  which  represent 
the  decision  region  boundaries  are  shifted  by  an  amount  DELTA 
as  demonstrated  in  Chapter  III  and  Eq  (83).  Figure  13  shows 
the  signal  set  with  the  decision  region  boundaries  as  they 
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DECISION  REGION  BOUNDARIES 


Fig  13.  Decision  Region  Boundaries  of 
Variation  Two 

now  appear.  From  this  it  is  evident  that  the  method  pre¬ 
viously  used  to  calculate  the  exact  Pg  is  legitimate  only 
for  signals  one  and  three.  Also  in  order  to  use  that 
method  for  s.  and  s^, ,  we  need  to  know  how  much  the  boundaries 
have  been  shifted.  From  Figure  14,  we  note  that  to  deter¬ 
mine  Pg  for  these  signals,  we  must  calculate  the  values  of 
A12’  fi14’  *32’  and  *34'  Equation  (83)  is  provided  again 
beiow : 
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A14  =  -1.0793 
A32  =  0.4023 

A34  =  -0.3304 

It  has  been  shown  that  the  boundary  moves  toward  the  signal 
of  lesser  probability  and  Figure  14  displays  this  fact  and 
the  amount  four  of  the  boundaries  have  been  moved.  In  order 
to  determine  P{e|m^},  we  note  that  an  error  will  be  made  if 
n^  is  greater  than  (2  -  0.3466)  =  1.6534  or  is  greater 

than  (2  -  1.0793)  =  0.9207  .  Then  as  before 

P{ejm1}  =  Q [1 . 6534]  +  Q[0.9207] 

-  Q[1.6534]*Q[0.9207] 


Plejrt^}  =  0.2186 

For  signal  three,  we  see  an  error  will  occur  if  n^  is  greater 
than  (2  -  0.3304)  =  1.6696  or  if  n2  is  greater  than 
(2  +  0.4023)  =  2.4023  .  Hence, we  compute 

P{e!m3)  =  Q  [1 . 6696 )  +  Q[2.4023] 

-  Q [1. 6696] *Q [2 .4023] 


P{eim3l  =  0.05532 

Table  VII  provides  the  program  returned  results  for  this 
variation  of  the  problem.  By  examination  of  the  table,  we 
first  note  that  the  signal  probabilities  have  been  appro¬ 
priately  changed,  yet  the  energy  and  signal- to-noise  ratios 
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TABLE  VII 


DIAL  V '  :  t  : i  F  ROBABILIT  i  OF  FiFlRUR  i 


remain  the  same  as  the  original  problem.  Comparison  to 
the  computations  of  the  union  bound  on  P&  shows  them  to  be 
as  close  as  round-off  error  will  allow.  Finally,  comparison 
of  the  integrated  Pg  for  signals  one  and  three  (found  in 
OPTION>  12  of  Table  VII)  with  the  actual  Pg  computed  above, 
reveals  the  two  differ  by  less  than  two-tenths  of  one  per¬ 
cent  . 


Variation  Three:  Deletion  of  Signal.  We  return  to 
the  original  problem  and  using  OPTION>  3,  signal  s^  is 
deleted  from  the  signal  set.  Since  the  union  bound  is  the 
only  value  not  previously  computed,  we  apply  Eq  (66)  once 
again  to  determine  the  values  below: 

Pleln^}  =  0.02515 
P{e|m2>  =  0.0455 
P{e|m3>  =  0.02515 

Comparison  with  the  values  found  in  Table  VIII  shows  the  two 
computations  to  be  nearly  identical.  The  calculation  of  the 
actual  PQ  for  signal  s2  has  already  been  validated.  For 
signals  s^  and  Sg,  however,  the  previous  method  of  manual 
calculation  is  not  possible.  The  necessity  of  integrating 
the  inseparable  joint  density  of  the  noise  components  pre¬ 
vents  a  comparison  from  being  made.  Note  that  in  this  case 
the  integrated  is  less  than  the  union  bound  value  for  Pe; 
hence,  the  approximation  obtained  by  integration  provides  a 
tighter  bound. 
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TABLE  VIII 


TOTAL  SYU'i.'K  PROBABILITY  OF  ERROR  {  <  .30/9P-01 


J 


Variation  Four:  Addition  of  a  Signal.  Using 
OPTION>  5  allows  a  signal  at  (0,4)  to  be  added. 

1.  Signal  Energy.  The  energy  of  the  newly  added 
signal  is  computed  from  Eq  (79)  as 

Energy  =  0  +  (4)^  =  16  joules 

2.  Signal-to-Noise  Ratio.  Similarly,  we  use 
Eq  (78)  to  find  the  SNR  for  signal  five. 

E 

S  c  iff 

|  db  =  10  log  10  =  9.0309  db 

o 

3.  Union  Bound  on  the  Probability  of  Error.  Since 
the  signals  are  once  again  equiprobable ,  Eq  (66)  is  used 
and  provides  the  values  below: 

P{e|m1}  =  0.1269 
P{e|m2)  =  0.0485 
P{e|m3}  =  0.0485 
P{ejm4)  =  0.1269 
P{e|ro5)  =  0.1592 

Using  Table  IX  for  comparison  of  these  statistics,  once 
again  the  program  returned  values  are  validated. 

4.  For  the  reasons  outlined  in  the  previous  varia¬ 
tion,  the  calculation  of  the  exact  Pp  is  not  done  for  this 
example . 
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TABLE  IX 


11.6 


TOTAL  BY B  I  KM  PROBABILITY  OF  ERROR 


Analysis  of  Integrated  Probability  of  Error 

In  order  to  demonstrate  the  effectiveness  of  the 
program  in  providing  a  reliable  approximation  of  the  actual 
probability  of  error,  two  conditions  must  be  met.  First, 
the  value  of  returned  for  any  given  signal  must  be  insen¬ 
sitive  to  rotation  of  the  signal  set.  Translation  of  the 
signal  set  is  not  relevant  since  prior  to  any  computation, 
the  signal  is  translated  to  the  origin  as  described  in 
Chapter  III.  Secondly,  for  reasons  already  discussed,  we 
require  the  calculated  value  to  be  greater  than  or  equal  to 
the  actual  probability  of  error.  The  method  chosen  to  dem¬ 
onstrate  the  successful  achievement  of  these  criterion 
simultaneously  is  as  follows: 

*  The  integrated  Pe  for  each  signal  in  the  signal 
set  of  Figure  12  is  determined 

*  The  signal  set  is  rotated  15  degrees 

*  The  integrated  Pg  is  again  computed 

*  This  procedure  is  continued  a  total  of  six  times 
resulting  in  a  total  rotation  of  90  degrees 

The  test  results  are  presented  in  Table  X.  The  first  row 

gives  the  statistics  for  the  original  signal  set  as  presented 

earlier  in  Table  V.  The  subsequent  rows  provide  the  results 

for  successive  15°  rotations.  As  can  be  seen,  the  computed 

probability  does  vary  as  the  signal  set  is  rotated,  but  the 

largest  deviation  from  the  actual  value  is  still  less  than 

1.6  percent.  More  importantly  is  the  fact  that  the  values 
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returned  always  slightly  over  bound  the  actual  probability 
of  error  as  desired,  but  never  more  than  1.6  percent. 

Manipulation  of  Graphic  Display 

This  part  of  the  verification  process  demonstrates 
that  the  graphical  presentation  actually  displays  the  signal 
set  and  its  decision  region  boundaries.  Furthermore,  we 
want  to  be  able  to  translate,  rotate,  and  scale  the  signal 
set  and  examine  the  results.  It  was  explained  in  Chapter 
III  that  these  operations  consist  of  appropriately  computing 
new  signal  point  coordinates  and  performing  all  required 
calculations  on  the  altered  signal  set.  The  mathematical 
procedure  does  not  change,  hence,  it  is  not  discussed  here; 
however,  the  graphical  representation  of  the  signal  set 
does  change.  The  best  approach  to  verify  this  ability,  then, 
is  to  provide  actual  program  generated  plots.  We  begin  with 
the  signal  set  shown  in  Figure  15.  Table  XI  lists  the  sig¬ 
nal  coordinates  and  the  system  statistics.  Figure  16  dis¬ 
plays  the  signal  set  with  the  decision  region  boundaries 
added. 

Translation.  Using  OPTION>  5,  the  signal  set  is 
translated  five  units  in  both  directions.  Figure  17  displays 
the  results  of  this  translation  and  Table  XII  provides  the 
statistics  of  the  altered  signal  set.  We  note  that  the  sig¬ 
nal  coordinates,  hence  the  signal  energies  and  signal-to- 
noise  ratios,  have  been  adjusted  according  to  their  new 
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Fig  15.  Nine  Point  Signal  Set  for  Graphical 
Verification 
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TABLE  XI 


TER  OF  GRAVITY  LOCATE!!  AT 


DECISION  REGION  BOUNDARIES 
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DECISION  REGION  BOUNDARIES 
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Fig  17.  Translated  Nine  Point  Signal  Set 
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TABLE  XII 


values.  The  computation  of  the  union  bound  on  P^  is 
unchanged  because  the  parameters  used  in  its  calculation 
have  not  been  changed  by  the  translation. 

Rotation .  The  signal  set  is  translated  to  its 
original  location  and  OPTION>  2  is  used  to  rotate  it  45 
degrees.  The  resulting  display  is  provided  in  Figure  18 
and  its  statistics  are  located  in  Table  XIII.  The  outcome 
is  as  expected.  Note,  these  operations  can  be  performed  in 
any  order  in  succession  and  as  an  example,  the  rotated  sig-. 
nal  set  is  translated.  Figure  19  and  Table  XIV  are  the 
result . 

Scaling.  As  described  in  Chapter  III,  there  may  be 
occasions  when  the  user  may  want  the  window  boundaries 
moved  out,  in  effect  expanding  the  field  of  view.  In  order 
to  demonstrate  this  capability,  the  original  nine  point  sig¬ 
nal  set  is  used  and  OPTION>  11  called  to  enter  a  scaling 
factor  of  two.  Figure  20  provides  the  outcome  of  this 
operation . 
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I 

i  Fig  19.  Rotated  and  Translated  Nine  Point 

i  Signal  Set 
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TABLE  XIV 


ri  F'KOBABILI  !  Y  Of  E-RKOH:  <  *  ■*'  1.6  OF +00 


Fig  20.  Display  of  Nine  Point  Signal  Set 
Scaled  By  Two 
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V.  Conclusions  and  Recommendations 


In  this  project,  a  computer  program  was  developed 
to  interactively  solve  problems  relating  to  signal  detec¬ 
tion  theory.  Use  of  the  Tektronix  PLOT-10  graphics  package 
provides  visual  display  of  the  problems  being  solved.  In 
particular,  the  user  selects  the  signal  set  and  specifies 
the  channel  parameters,  then  the  program  displays  the 
resulting  decision  region  boundaries  and  computes  the  sta¬ 
tistics  of  each  signal  and  the  system  in  general.  The 
results  of  varying  any  parameter  can  be  quickly  determined 
and  displayed.  As  an  aid  in  studying  signal  detection 
theory,  the  program  allows  the  user  to  investigate  the 
interactions  of  the  system  parameters  without  having  to 
perform  hours  of  tedious  computations.  The  user  can  thus 
learn  how  proper  selection  of  signal  set  and  system  para¬ 
meters  can  optimize  the  probability  of  correctly  receiving 
transmitted  messages. 

The  program  may  be  executed  from  any  interactive 
computer  terminal  which  is  supported  by  the  FORTRAN  77 
compiler  and  has  access  to  the  International  Mathematical 
and  Statistical  Library  (IMSL)  routines  MDNOR  and  MDBNOR . 
However,  for  visual  displays,  the  use  of  Tektronix  terminals 
model  4014,  4012,  or  4010  is  essential.  The  ability  to 
plot  the  decision  region  boundaries  at  any  interactive 
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terminal  would  increase  the  flexibility  and  use  of  the  pro¬ 
gram.  It  is  recommended  that  the  feasibility  of  adding 
this  plotting  capability  be  pursued. 

Secondly,  the  program  as  designed  maintains  the 
user  supplied  input  data  in  temporary  core  storage  only. 

Thus,  each  time  the  program  is  executed,  a  signal  set  must 
be  made.  This  is  not  a  severe  limitation  when  working  with 
small  signal  sets,  i.e.,  those  with  less  than  ten  signal 
points.  However,  when  working  with  larger  signal  sets,  the 
amount  of  time  required  to  specify  the  signal  set  linearly 
increases.  The  capability  to  file  these  larger  signal  sets 
outside  the  main  program  and  to  be  able  to  attach  the  file 
for  use  later,  would  be  beneficial  to  those  doing  analysis 
of  a  particular  signal  set  over  an  extended  period  of  time. 

It  is  suggested,  therefore,  that  the  feasibility  of  such  an 
alteration  be  studied  and  this  capability  added  to  the 
existing  program. 

As  a  final  note,  the  current  configuration  of  the 
program  fully  utilizes  the  allocated  dynamic  storage  capacity 
of  the  interactive  system  (CYBER  INTERCOM).  Thus,  in  order 
to  implement  either  of  the  proposals  above,  the  program 

would  have  to  be  restructured  to  use  overlays  or  the  amount 
of  allocated  dynamic  storage  space  would  have  to  be 
i ncreased . 
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Appendix  A:  Supporting  Derivations 


Derivation  I  Derivation  of  the  Mean  and  Variance  of  the 

Sufficient  Statistic  of  the  General  Gaussian 
Problem 


The  sufficient  statistic  as  determined  in  the  text 
of  Chapter  II  (Eq  (24))  is  given  by 


*(z)  =  (s2  -  s1)T  V  1  z 


(24) 


Since  zk  =  sk  +  n 


The  expectation  of  £  given  message  k  becomes 

E{£(mk}  =  E [(s2  -  s1)T  V-1  (£k  +  n)] 
T  —  1 

Since  (s2  -  s^)  V  is  a  constant  and  E{n} 
have 


(A-l ) 
0  ,  we 


E { t ' m^ }  =  E[(s2  -  s-^)7  V-1  sk] 


=  Cs2  -  s1)T  V-1  sk 


(A-2) 


The  variance  is  computed  from 


Var  { /.  J  m,,  1  =  E  [ "  j  rn,  }  -  [E  { £  j  m,_ } ) 


( A-3 ) 


where  E{£|mk)  is  given  by  Eq  (A-2)  and  E{£  |mkl  is 
determined  below. 
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EU2|mk)  =  E((£2  -  s1)T  V  1  (sk  +  n) 


(s2  -  V-1  (sk  +  n)} 


=  E{(s2  -  s1)T  V"1  (sk  +  n) 


(sk  +  n)T  V  1  (s2  -  Sl)}  (A-4 ) 


Multiplying  out  the  two  center  terras  yields 


/jt  fp  fji  Y 

(sk  +  n)  (sk  +  n)  =  sk  sR  +  sR  n  +  n  sk  +  n  n 


Hence,  the  expectation  of  this  product  can  be  written 

E((sk  +  n)  (sk  +  n)T}  =  E{sk  skT  +  sk  nT  +  n  skT  +  n  nT} 

T 

And  since  E{n}  =  0  and  E{n  n  }  =  V  ,  the  expectation  of 
the  product  becomes 

E{(sk  +  n)  (sk  +  n )T)  =  sk  skT  +  V  (A-5) 

By  substitution  into  Eq  (A-4) 

E{«.2|mk}  =  (s2  -  V-1  (sk  skT  +  V) 

V-1  (s2  -  s1)  ( A-6) 

Multiplying  this  out  yields 

E{P.2|rak>  =  [(s2  -  s 1)T  V'1  sk  skT  +  (s2  -  s1)T  V-1  V) 


Y"1  (s2  -  s1) 
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Substitution  of  Eqs  (A-2)  and  (A-7)  into  Eq  (A-3)  results  in 
Var  {  £  i  raR }  =  («2  -  s1)T  V-1  (s2  -  s^  (A-8) 

Using  the  definition  for  As  as  in  Chapter  II 

As  =  s2  -  s^ 

We  conclude  by  substitution  into  Eq  (A-2)  to  obtain  the 
s impl i f ied  means 

EUlrn^  =  AsT  V-1  sx 

E { £ | m2 }  AsT  V-1  s2  ( A-9) 

And  the  simplified  variance 

Var  f  £ | mR}  =  AsT  V-1  As  for  k  =  1,  2 . I  (A-10) 
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Derivation  II  Derivation  of  the  Probability  of  False 
Alarm  Eg  (30) 

We  begin  with  the  probability  of  false  alarm  as 
determined  in  Chapter  II  by  Eq  (29)  which  is  provided  again 
below . 


FA 


OC 

■I 


A  T  _  I  A 

(2t:)-;  (As  V  As)2 


exp 


T  - 1  ? 

(£  -  As1  V  s1)‘i 

_  — ^ 

As  V  As 


If  we  let  B  = 


£  -  AsT  V  1  s1 
(AsT  V-1  As) 2 


d£  (29) 


Then  its  derivative  becomes 


dB  = 


d£ 


T  -1  A 

(As  V  As)2 


Now  by  substitution  and  appropriate  adjustment  of  the  limits 
of  integration,  Pp^  becomes 


PFA  = 


(  , 

B*1 

) - exp 

-  — 

/  / 2  ~ 

dg 


A  '  -  As1  V  ‘ 


-  JL  -1 


( AsT  V  1  As) 


(A-ll) 
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Using  the  Q- function  transformation 


PFA  =  « 


T  - 1 

A '  -  As  V  sx 
_  — -  “ 

(As1  V  As ) 


( A-12 ) 


From  Eq  (24)  of  Chapter  II,  we  know 


A'  =  InA  +  |  ls2T  V  1  s2  -  s^  V  1  s±] 


Substitution  into  Eq  (A-12)  gives 


PFA  " 


1  T  _1  1  -1  T  —  1 

InA  +  2  X  s 2  -  2  X  — 1  “  ^—2  "  — l ) 1  X  s. 

—  —  — 

(As1  V  As)" 


( A-13) 


And  because 


,  t  _  i  t  - 1  T  -1 

“  -1-*  —  =  ®2  -  ®i  ~  .§1  X 


Substituting  again  gives 


IT-1  1  -1  i  t  -1  1  T 

inA  +  2  s2  X  ~  ®2  +  "5  — !  —  ®l-f®2  X  V  s2 


T  -1 

(As  V  As)' 


Using  matrix  algebra  and  combining  like- terns  vie  Ids 


( A-14 ) 


!nA  +  |  (s2  -  Sj^'x  1  (s2  -  sx) 

PFA  =  Q  . .  T  -1  ,  A 

(As  V  As)" 


( A-15) 
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The  definition  for  As  as 

As  =  -  sx) 

Provides  Eq  (30)  as  desired. 


PFA  =  « 


InA 


/a  T  1  \  J 

(As  V  As) 


T  —  1  I 

(As1  V  As)2 


(30) 


Derivation  III  Derivation  of  the  Simplified  Expression  for 

the  Union  Bound,  Eq  (66) 

We  begin  with  Eq  (63),  rewritten  below 

Prf  li  z  ~  \\2  >  II  z  -  s£  ||2|mk) 


Let 


=  Pr{2nT  (s£  -  sk)  >  ||  s£  -  sk  ||2}  (63) 


8  =  2nT  (s£  -  sk)  =  2(s£  -  sk)T  n 


=  T.  2n.  Is  -  s  ]  (A-16) 

i=l  1  *i  Ki 


We  take  the  expectation  of  8  to  determine  its  mean,  since, 


E  (  n  i }  =  0 


E  { 3  }  -  0 


(A-17) 


Because  the  mean  of  8  is  zero,  its  variance  is  computed  from 


Var { 8 )  =  E{3  } 
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IV h  i  c  h  bc'comps 


=  E{[2nT  (sp  -  sr)]T  [2nT  (s£  -  SR ) ] } 

=  E { [4  (s?  -  sk)T  n  nT  (s£  -  sR ) ) } 

=  4  ~  Mk)  E^n  HT>  (s£  -  sR)  ( A-18) 

Now,  since 

E{ n  nT}  =  a2I  ( A-19) 

We  get 

V ar { 5 }  =  4a2  (s£  -  sk)T  (s£  -  sk) 

=  4^2  I!  -  £k  ||2  (A-20) 

By  substitution  of  Eq  (A-16)  into  Eq  (63),  we  find 

Pr{e|mk)  =  Pr{  ||  z  -  sR  ||2  >  ||  z  -  s^  1 1  2  | mk > 

=  Pr{B  >  |!  -  sk  ||2}  ( A-21) 

Since  8  has  been  shown  to  be  gaussian  with  zero  mean  and 
variance  given  by  Eq  (A-20),  the  conditional  probability  of 
error  can  be  written 
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APPENDIX  B 


Flow  Charts 

This  appendix  presents  the  flow  charts  for  the  main 
program  and  the  23  subroutines.  To  prevent  confusion,  the 
symbols  used  are  defined  below. 


Process 


Any  processing  function  causing  a 
change  in  value 


Input/ 

Output 


General  input/output  function 


Display 


Information  displayed  via  graphics 
subroutines 


Initialization  of  parameters  or 
vari ables 


r  Start/  "N 
Return/ 


Beginning  or  ending  of  subroutine. 

The  routine  name  is  used  at  the  start 
and  "RETURN"  is  used  at  the  end. 
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On  page  connector,  letters  used. 


Off  page  connector.  The  first 
number  indicates  page  of  Appendix  B 
where  routine  is  continued,  and  the 
second  indicates  location  on  the  page. 


In  addition  to  normal  abbreviations,  the  following 
special  abbreviations  are  used: 


CNT 

Connecting  or  Connector 

COORD 

Coordinate(s) 

HORT 

Horizontal 

INSTRCT 

Instruction(s) 

INTRSCT 

Intersection 

LD  PT 

Lead  Point 

POX 

Point  of  Intersection 

PROB 

Probability 

VERT 

Vertical 

The  index  located  on  the  next  page  is  included  to 
facilitate  locating  the  flowcharts  for  the  individual 

four,  ines . 


If  3 


A 


Routine 


1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 
9. 

10. 

11. 

12. 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20. 
21. 
22. 

23. 

24. 


Main  Program  SIGDET 

CURSOR  . 

DIRECT  . 

TRANS  . 

ROTATE  . 

ADDGRA  . 

ADDDIR  . 

DELETE  . 

SNOISE  . 

SGPR03  . 

SCALER  . 

SGENGY  . 

SNRCO.M . 

GRACEN  . 

WINDOW  . 

BISECT  . 

POINTS  . 

REGION  . 

PERROR  . 

EXACT  . 

CMPUTE  . 

PLOT . 

DECIDE  . 

OUTPUT  . 


1S.I 
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14  7 


fc>  CO  O 


10.  Subroutine  SGFRCI; 


'O'. 


tin*;  SGEliGY 
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6-1 
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APPENDIX  C 


User ' s  Manual  for  Program  SIGDET 

Overview  of  SIGDET 

SIGDET  is  designed  as  a  learning  tool  for  those 
studying  the  signal  detection  and  estimation  aspects  of  com¬ 
munications  engineering.  Specifically,  it  is  an  interactive 
computer  program  intended  for  use  in  the  analysis  of  the 
optimum  communication  receiver  design  problem.  Addition¬ 
ally,  a  graphical  capability  has  been  included  to  provide 
a  pictorial  display  of  the  signal  set  being  studied,  its 
decision  boundary  regions,  and  system  statistics.  Some  of 
the  features  and  capabilities  include: 

*  Analysis  and  manipulation  of  between  2  and  33  sig¬ 
nal  points 

*  Two  methods  of  inputting  signal  set  points 

*  Ability  to  add  or  delete  signals  any  time 

*  Ability  to  translate  or  rotate  signal  set 

*  Ability  to  specify  individual  signal  probabilities 
and  system  noise  energy 

*  Provide  graphical  display  of  signal  set  and/or 
decision  regions 

*  Provide  listing  of  system  statistics  including 

probrib-5 1  i  ty  of  error.  S\'f{ ,  con  cor  of  gravity, 
signal  energies,  etc. 

The  emphasis  in  the  development  of  the  program  has 
been  placed  on  simplicity  of  use  and  this  manual  is  intended 
to  demonstrate  the  range  of  options  available  and  their 
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proper  use.  No  attempt  is  made  here  to  justify  the  algo¬ 
rithms  used  or  the  assumptions  inherent  in  the  design  of  the 
algorithms . 

Initialization  and  System  Flowchart 

SIGDET  uses  the  Tektronix  PLOT  10  graphics  package 
and  in  order  to  use  the  graphical  capability  of  the  program, 
one  of  the  Tektronix  computer  terminals  must  be  used.  The 
program  is  written  for  use  with  Tektronix  Model  4014  termi¬ 
nal,  but  will  perform  adequately  on  models  4010  and  4012 
with  little  degradation  of  output  display.  Additionally,  in 
the  computation  of  the  probability  of  error,  several  ISML 
subroutines  have  been  used.  Prior  to  using  SIGDET,  the 
graphics  package  and  the  ISML  routines  must  be  attached  for 
proper  execution  of  the  program.  This  manual  provides  a 
sample  listing  of  the  CYBER  prompts  and  the  user  ATTACH  and 
LIBRARY  commands  necessary . 

Once  the  program  has  been  compiled  and  is  in  execu¬ 
tion,  the  user  is  in  control.  SIGDET  operates  in  one  of 
two  modes.  The  first  is  the  OPTION  mode  and  upon  the  prompt 
OPTION  >  ,  the  user  inputs  the  number  of  the  program  function 
desired.  There  are  currently  14  options  available  and  each 
is  described  separately  Later  in  this  manual.  The  second 
mode  is  the  DATA  mode.  Any  time  the  program  requires  data, 
a  prompt  specifically  requesting  what  information  is  needed 
will  be  given,  followed  by  the  >  symbol  which  indicates 
that  SIGDET  is  waiting  for  the  requested  data.  If  more  than 


one  item  per  >  prompt  is  required,  the  inputted  data  must 
be  separated  by  a  comma.  A  carriage  return  by  the  user  sig¬ 
nifies  all  data  has  been  entered  and  execution  is  to  con¬ 
tinue  . 

The  most  basic  data  SIGDET  requires  are  the  number 
of  signals  in  the  signal  set  and  a  specification  of  those 
signals.  All  other  parameters  have  default  values  which  are 
assumed  unless  the  user  alters  them.  The  flowchart  below 
indicates  the  main  program  prompts  for  inputting  this  basic 
data  and  functions  as  a  road  map  to  assist  the  user  in  the 
operation  of  the  program.  One  word  of  caution:  once  the 
user  specifies  an  option,  he  will  continue  in  that  option 
until  it  has  completed  its  function.  In  order  to  terminate 
the  program  or  start  over,  he  must  be  in  the  OPTION  mode. 

MAIN  PROGRAM 

First  Prompt 

Second  Prompt 

Third  Prompt 
("2"  entered) 


Screen  blanks,  window  box  is  drawn, 
x-y  axis  indicated  by  dotted  lines, 
and  cursor  lines  provided. 


Third  Prompt 
("3"  entered) 


First  Notice: 


Second  Notice: 


Fourth  Prompt 


User  positions  cross  point  and  enters  P 
to  enter  point.  After  all  points 
entered,  listing  of  coordinate  pairs  is 
displayed  at  bottom  of  screen. 


See  individual  option  numbers 


Ont  i  t>n_s 

The  fourteen  options  currently  available  in  SIGDET 
are  listed  below.  Those  marked  with  an  asterisk  are  avail¬ 
able  only  on  Tektronix  Graphics  ierminals. 

1.  Translate  signal  set 
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2.  Rotate  signal  set 


3.  Delete  a  signal 

*  4.  Add  a  signal  using  graphical  cursor 

5.  Add  a  signal  by  specifying  coordinate  pairs 

6.  Enter  individual  signal  probabilities 

*  7.  Display  current  signal  set 

*  8.  Display  decision  regions 

9.  Provide  listing  of  statistics  of  individual 
signals  and  overall  system 

10.  Enter  noise  energy 

11.  Scale  display  boundaries 

12.  Numerical'  integration  of  decision  regions 

13.  Start  over 

14.  Terminate  program 


OPT I ON >  1  Translate  Signal  Set 

PURPOSE:  To  allow  user  to  move  entire  signal  set  any¬ 

where  in  X-Y  plane.  (Note:  Unpredictable 
results  may  occur  if  any  signal  is  allowed  to 
have  any  energy  over  10s  units.) 

PROMPTS:  To  translate  signal  set ,  enter  amount  of  move¬ 

ment  in  the  X  and  Y  directions 

DELTA  X  > 

DELTA  Y  > 

EXECUTION:  The  values  of  DELTA  X  and  DELTA  Y  are  added  to 

the  :<:~y  coordinates  of  each  signal  and  all 
computations  are  redone.  Hence,  the  effect  is 
that  of  maintaining  the  original  frame  of 
reference  and  relocating  all  signal  points 
with  reference  to  it. 

Point  of  return  to  Main  Program:  C 


OPTION>  2  Rotate  Signal  Set 

PURPOSE:  To  allow  user  to  rotate  the  signal  set  about 

its  current  X-Y  axis. 

PROMPTS:  To  rotate  signal  set ,  enter  amount  of  rotation 

in  degrees ,  positive  or  negative ,  zero  to  360. 

angle"  = 

EXECUTION:  The  input  angle  is  checked  to  assure  that  its 

absolute  value  is  less  than  or  equal  to  360. 
New  values  for  the  X-Y  coordinates  of  each 
point  are  determined  and  all  computations 
redone . 

Point  of  return  to  Main  Program:  C 


0PTI0N>  3  Delete  a  Signal 

PURPOSE:  To  allow  user  to  remove  unwanted  signal  with¬ 

out  having  to  start  over. 

PROMPTS:  Enter  the  number  of  the  signal  to  be  deleted. 

Delete  signal  > 

EXECUTION:  The  signal  set  is  reordered  with  the  deleted 

signal  removed.  Only  one  signal  may  be  deleted 
at  a  time. 

Point  of  return  to  Main  Program:  B 


OPT I ON >  4  Add  a  Signal  Via  Cursor 

PURPOSE:  To  allow  user  to  add  a  signal  using  the  cursor 

provided  with  the  graphics  package. 

PROMPTS:  Screen  will  blank  and  current  signal  set  will 

be  displayed.  Under  the  display,  the  following 
prompt  is  given: 

Enter  a  ”2"  to  clear  cors.m:  and  obtain  lie  tine 
of  signal  point  coordinates .  Otherwise  enter 

n  Tf  7  ” 

Ci  u  • 

EXECUTION:  User  must  input  a  ”3"  at  this  prompt  in  order 

to  have  cursor  available.  After  positioning 
the  cross  poinf  ,  user  types  in  a  "P"  to  enter 


point  into  signal  set.  At  bottom  oi  screen, 
coordinates  of  new  point  will  be  provided. 

NOTE:  Point  entered  must  be  within  box  displayed, 

otherwise  the  following  error  message  may 
appear: 

Error  encountered }  check  input  and  reenter. 

Program  then  returns  to  A 

In  order  to  enter  a  point  outside  box  via 
cursor,  user  should  rescale  first.  (Option  11) 

Point  of  return  to  Main  Program:  B 


OPT I ON >  5  Add  a  Signal  Via  Specification 

PURPOSE:  To  allow  user  to  add  a  signal  by  entering  the 

X  and  Y  coordinates  of  the  new  point. 

PROMPTS:  Enter  V  and  Y  coordinates  of  added  signal 

X  coordinate  > 

Y  coordinate  > 

EXECUTION:  The  added  signal  coordinates  are  included  in 

the  signal  set  and  all  computations  are  redone. 

Point  of  return  to  Main -Program :  B 


OPT  I  ON  >  6  Enter.  Signal  Probabilities 

PURPOSE:  To  allow  the  user  to  specify  the  probability 

of  each  signal. 

PROMPTS:  Please  enter  signal  probabilities 

Signal  1  > 

Signal  2  > 


Signal  n  > 

EXECUTION:  The  equally  likely  default  signal  probabilities 

are  superseded  by  user  entered  values.  Note: 

If  the  sum  of  the  entered  probabilities  is  not 
in  the  range  0.95^P^I.05,  the  following  error 
message  will  be  given: 


Sum.  of  signal  probabilities  is  not  within  5% 
of  unity.  Please  reenter  more  accurate  signal 
prohabi l i ties . 

The  original  prompts  are  then  given  again. 
Point  of  return  to  Main  Program:  C 


OPTION>  7  Display  Current  Signal  Set 

PURPOSE:  To  provide  user  with  graphical  display  of  the 

current  signal  set  and  a  listing  of  signal 
point  coordinates. 

PROMPTS:  Screen  will  blank  and  current  signal  set  will 

be  displayed.  The  X-Y  axis  is  displayed  as 
dotted  lines.  At  bottom  of  display,  the  fol¬ 
lowing  prompt  is  given: 

Enter  c.  "2"  to  clear  screen  and  obtain  listing 
of  signal  point  coordinates .  Otherwise  enter 


EXECUTION:  The  pause  is  provided  in  order  to  allow  the 

user  to  copy  the  display,  if  desired.  If  "2" 
is  typed  in,  screen  will  clear  and  coordinates 
of  signals  will  be  displayed  accurate  to  1/100 
of  a  unit.  If  a  "3"  is  typed  in,  return  to 
main  program  is  initiated  without  clearing  the 
screen . 

Point  of  return  to  Main  Program:  C 


OPT I ON >  8  Display  of  Decision  Regions 

PURPOSE:  To  provide  user  with  graphical  display  of  the 

signal  set  along  with  the  decision  boundary 
regions  for  each  signal . 

PROMPTS :  No  prompts  are  given. 

EXECUTION:  Screen  will  blank  and  display  of  signal  set 

with  decision  boundary  regions  provided. 

Point  of  return  to  Main  Program:  C 
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OPTION>  9  Signal  and  System  Statistics 

PURPOSE:  To  provide  user  with  the  following  statistics 

for  each  signal: 

+  Signal  coordinates 
+  Probability 
+  Energy 

+  Signal  to  Noise  Ratio 
+  Union  Bound  on  Probability  of  Error 

Provides  the  following  system  statistics: 

+  System  Noise  PSD 
+  Total  System  Energy 
+  Total  Probability  of  Error 
+  System  Center  of  Gravity 


PROMPTS:  No  prompts  are  given. 

EXECUTION:  Appropriate  headings  are  provided  and  tabular 

listing  of  indicated  statistics  typed  out. 


Point  of  return  to  Main  Program:  C 


OPT ION >  10  Enter  Noise  Energy 


PURPOSE : 

PROMPTS : 


To  allow  user  to  specify  the  system  noise 
energy. 

For  a  max  SNR  of  zero  db ,  noise  energy  must 
b e :  xxx 

The  desired  noise  energy  is  > 

After  user  enters  noise  energy  the  notice  below 
appears : 

This  yields  a  noise  PSD  or  variance  of:  yyy 


EXECUTION:  The  default  noise  energy  which  provides  a  PSD 

or  variance  of  1.0  is  superseded  by  user  entered 
value.  The  signal  having  the  greatest  energy 
is  determined  and  the  noise  energy  required  to 
result  in  a  SNR  of  zero  db  is  determined.  This 
value  is  provided  to  the  user  for  "ranging" 
purposes . 


Point  of  return  to  Main  Program:  C 
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OPT I ON >  11  Enter  Seal ing  Factor 

PURPOSE:  To  allow  user  the  capability  of  expanding 

dimensions  of  displayed  signal  set.  This  allows 
the  display  of  previously  "cut  off"  boundary 
regions  or  the  adding  of  signal  point  via  the 
cursor  outside  original  region. 

PROMPTS:  To  scale  window  dimensions ,  enter  scaling 

factor . 

To  reduce  window  size,  factor  must  be  between 
zero  and  one. 

To  increase  window  size,  factor  must  be  greater 
than  one. 

Scale  factor  > 

EXECUTION:  The  original  dimensions  are  multiplied  by  the 

scale  factor.  Note:  Unpredictable  results  may 
occur  when  reducing  dimensions  if  scaling 
causes  signals  to  be  outside  new  dimensions. 

Point  of  return  to  Main  Program:  C 


OPT I ON >  12  Numerical  Integration  of  Probability  of  Error 

PURPOSE:  To  provide  user  with  a  very  close  estimation 

of  the  probability  of  error  of  each  signal  and 
the  system. 

EXECUTION:  Each  decision  region  is  approximated  by  hun¬ 

dreds  of  rectangular  regions.  Integration  of 
the  Bivariate  Normal  Density  over  each  rec¬ 
tangle  provides  the  probability  of  a  correct 
decision.  Subtraction  of  this  value  from  unity 
yields  the  probability  of  error.  After  the 
calculation  is  complete,  a  tabular  listing  of 
each  signal,  its  probability  of  occurrence, 
and  probability  of  error  is  provided. 

PROMPTS:  At  conclusion  of  the  output  listing,  the  user 

is  provided  the  prompt: 

For  Greater  resolution,  enter  a 
Otherwise,  enter  any  other  digit. 

If  a  closer  estimation  is  desired,  the  user 
responds  by  entering  a  "2"  and  calculation  is 
done  again  using  tighter  parameters.  Note: 

The  greater  the  resolution,  the  greater  CPU 
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time  required.  In  general,  the  first  compu¬ 
tation  requires  about  one  second  of  CPU  time 
per  signal  point. 

Point  of  return  to  Main  Program:  C 


OPTION>  13  Start  Over 

PURPOSE:  To  allow  user  to  return  to  beginning  of  program 

without  having  to  recompile  it. 


PROMPTS:  Since  program  returns  to  the  beginning,  the 

initial  prompts  are  again  provided. 


EXECUTION:  Returns  to  start  of  Main  Program. 


Point  of  return  to  Main  Program:  A 


OPT I ON >  14 
PURPOSE : 
PROMPTS : 
EXECUTION: 


Terminate 
Terminate  program. 

No  prompts  are  given. 
Ends  program  execution. 
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boundaries.  Modification  to  signal  set  may  be  performed  via  trans 
lation,  rotation,  or  scaling,  and  deletion  or  addition  of  signals. 

The  programming  language  used  was  FORTRAN  77  with  graphical 
capability  provided  thru  the  Tektronix  PLOT-10  graphics  package. 
The  program  (less  graphical  capability)  may  be  executed  from  any 
interactive  terminal  supported  by  the  FORTRAN  77  compiler  and  the 
International  Mathematical  &  Statistical  Libraries  (IMSL)  routines 
MDNOR  and  MDBNOR.  For  graphical  displays,  use  of  Tektronix  ter¬ 
minals  model  4014,  4012,  or  4010  is  required. 
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